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Fig. 1.1. Notion of Algorithm 


jp.2. PROPERTIES OF ALGORITHM 

Simply writing the sequence of instructions as an algorithm is not sufficient to accomplis 
certain task. It is necessary to have following properties associated with an algorithm : 

(/) Non-ambiguity : Each step in an algorithm should be non-ambiguous. That means eac 
instruction should be clear and precise. The instruction in an algorithm should not denoi 
any conflicting meaning. This property also indicate the effectiveness of algorithm. 

(i/) Range of Input : The range of input should be specified. This is because normally th 
algorithm is input driven and if the range of the input is not been specified then algorithi 
can go in an infinite state. 


(iii) Multiplicity : The same algorithm can be represented in several different ways. Th 
means, we can write in simple english the sequence of instructions or we can write it in t 
form of pseudo code. Similarly for solving the same problem we can write several differe 
algorithms. For instance : For searching a number from the given list, we can use sequent 
or binary search. Here searching is a task and can use either a “sequential search” or “bina 
serach”. 


(iv) Speed : The algorithm are written using some specific ideas (which is popularly kno 
as logic of algorithm). But such algorithms should be efficient and should produce 
output with fast speed. 

(v) Finiteness : The algorithm should be finite. That means after performing requi 
operations it should terminate. 

^.3. ISSUES IN WRITING AN ALGORITHM 

There are various issues in the study of algorithm and those are : 

(i) How to Devise Algorithm ? 

The creation ol an algorithm is alogical activity and one can not automate it . But there 

certain algorithmic design strategies and using these strategies one can create many useful algoritl 

Hence mastering ol such design strategies is an important activity in study of design and analysi 

algorithm. 
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(Ill) How to Analyze Algorithm ? 

Analysis of algorithm is a task of, In, 
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Algorithm Heading 

It consists of name of algorithm, problem 
description, i/p and o/p. 


Algorithm Body 


It consists of logical body by making use of various 
programming constructs and assignment starts. 

In this section, we will discuss the notations used for algorithm that are covered below 
(0 An algorithm is described within a pair of lines : 

Procedure Name 


End Name 


O'O Assignment is denoted by 

Variable name «- expression 




(Hi) The symbol V indicates comments. 

«v) Arrow in both direction «-* is used to show esc J "r L 
(v) If condition is shown as : 


If condn then 
stmt (s); 
else 

stmt ( a ) ; 
end if; 


(vi) Do-loop is shown as : 



(v/7) Comment is shown as : 


/* start */ 


(viii) While construct is used as : 


While condn DO 


End while 


( ix ) Case construct is used as : 



(jr) Length [A] shows length of array. 

(jci) A[i.....j] shows array from / to j. 

(xii) Arithematic operators +, *, / and % are used. 

(xiii) Returning result is shown as : 


Return (value (s)) 


Example 1.1. To understand the expressing method. Lets consider an algorithm which sum 
‘w’ numbers. 
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Writhm ».l. Without PMiudo cod. 

Step 1 : Select n numbers. 

Step 2 : Set sum S to zero. 

Step 3 : Repeat from firs, number to nth number ie 
s = S + A |/] 

Step 4 : Return sum (S). 

Now wegive the same algorithm with pseudo code : 

Sum (a, n ) 

1. S 4- 0 

2. For i «- 1 to a 
3- S <- s + A [i] 

4. return S. 

WC Wi " 3gain give algonthm for sum but this algorithm is iterative algorithm 


(recursive 


Rec sum (A, n) 1 

1- S 0 

2. if (n ^ 0) then 

3. return 0 

4. else 

5 - return Rec_sum (A, n - 1) + A[n] 

j|-5. CORRECTNESS OF AN ALGORITHM 

For any algorithm we must prove that it always return the desired output for all legal instances 
of the problem. 


Example : For sorting, this means if : 

(a) The input is already sorted, 
or ( b ) It contains repeated elements. 

Correctness is not Obvious 

Suppose you have a robot arm equipped with a tool. Say a soldering iron. To enable the robot 
arm to do a soldering job, we must construct an ordering of the contact points. So, the robot visits 
the first contact point, then visit the second point, third and so forth until the job is done. 

Since, the robot are expensive, we need to find the order, which minimizes the time (ie , travel 
distance) it takes to assemble the circuit board. 



Fig. 1.2. Assembling of circuit board. 

r- i ninArithm for best tour to assemble the whole points % 
Now, the problem arises is that to find an algorithm tor best lour iu 

for the circuit board. 

h.6. ANALYSIS OF ALGORITHM 

Analysis of algorithm means developing a formula or prediction of how fast the algor.thm 
works bassed on the problem size. 

The problem size could be : 

(/) The number of inputs/outputs in an algorithm. 

(ii) The number of operations involved in an algorithms. 

The analysis of algorithm based on time of computation is called as time complexity of the 

algorithm. 

Analysis of algorithm is also defined as the process of determing a formula for prediction of 
the memory requirement (primary memory) based on the problem size called space complexity of 

the algorithm. 

Analyzing of an algorithm is 
concerned of three cased : 

1 . Worst case complexity 

2. Best case complexity 

3. Average case complexity 

1. Worst Case Complexity : 

The worst case complexity of an 
algorithm is the function defined by 
the maximum number of steps taken 
on any instance of size n. 

2. Best Case Complexity : 

The best case complexity of an 
algorithm is the function defined by 
the minimum number of steps taken 
on any instance of size n. 


I •• 



Worst Case 


Average Case 


Best Case 
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3. Average Case C omplexity : The av» 
defined by the average number of steps talci t ^ 
Each of these function defines a num * 

(a) Time 

( b ) Space 

Example 1 . 2 . To unders (and the analysis'^ 

“Insertion sort”. 

One way to sort an array of V elements is to c 
new elements in the proper positions 


At each stage, the inserted elements leaves 2 a IL,i i, , 
the right elements. Thus, the algorithm must be correct. 

How Efficient Insertion Sort is ? 

Note that runtime changes with the permutations instance (even 

1. How does insertion sort do on sorted permutat.on ? 

2. What about unsorted permutations ? 

Analysis of Insertion Sort 


urithm is the function 


(inside 


sample of 


Line 

V.WUC will uc CXI 

Insertion Sort (A, n) * | nc , ( 

1. 

Fory 2 to length [AJ do [ “c 

2. 

Key <— A {/] c ‘ 

3. 

/ * put A [/] in to A [1 ....] - 1 )*/ c 

4. 

1 <—j - 1 C 4 

5. 

While / > 0 & A [ 1 ] > key do 1 c 

6. 

4[i+ 1]<-A[/J c * 

7. 

1 < — 1+1 Q 

8. 

A[/ + I J +- key q 


(n - I) times. 

Let tj i 1+0 the number of elements that have to be slide right to insert the /th 
Step 5 is executed t 2 + /, + ... + t n times. 

Step 6 is executed t 2 - 1 + t 3 _ , + .... t n _ 

Now. add up the executed instructions for all pseudo code lines to get the run 

algorithm : 


:cuted 


item 


time of the 


T = C, . n + C 2 . (w - 1) + C 4 . (/i - 1) + C 5 . + C 6 . £(7 ; - 

+ C-j . Tiff, - 1) + Cq (n — 1) 


..( 1 . 1 ) 


arc (he I 's ? They depend on a particular input. 
best case : If it is already sorted, all »/• are 


Hence, the best case time put t, - • •*> ct I n 


( 1 . 1 ) we get 


_ , ,\j.r Vi +0 + 0 + C«(n-D 

T = C,.n + Cj.(n-I)+Q>"- |) + C 5 Z, l+U 8 

=> C,n + (C 2 +C 4 +C, +C 8 )(n-I) = " + I 

where C and D are constants. , w j|| have to slide all the alread 

For wars, case : If the input is sorted is decreasmg order, we w.M *** 

sorted element. So tj — j and st e P * s executed. 


11 “ + n 


v • n 
> / - = n 

~ 2-1 


i + /i 


fc.7. FUNDAMENTAL OF ALGORITHM SOLVING 

In computer science, developing an algorithm is an art or a skill. And we can have mastery 
,JnZT7op m n, p.« SS only when we follow eeruin me, hod. Before ,e,u.l nnplemeiM, 
of the program, designing an algorithm is a very important step. 

Supposes if we wan. to build a house we do no. directly star, constructing the house. Instead 
consult an architect, we put our ideas and suggestions, accordingly he draws a plan of the house i 
he discusses it with us. If we have some suggestion, the architect notes it down and makes 
necessary changes accordingly in the plan. This process continues till we are happy. Finally the b 
print of house get ready. Once design process is over actual construction activity starts. Now 
becomes very easy and systematic for construction of desired house. In this example, you will f 
that all designing is just a paper work and at that instance if we want some changes to be done til 
those can be easily carried out on the paper. Alter a satisfactory design the construction activi 
starts. Now it becomes very easy and systematic for construction of desired house. In this exam 
you will find that all designing is just a paper work and at that instance if we want some change 
be done then those can be easily carried out on the paper. After a satisfactory design the construe 
activities start. Same is a program development process. If we could follow same kind of appro 
while designing & analyzing the algorithm then we can have successful implementation for comp 
problems also. Let us list “what are the step, that need to be followed while designing & analyi 
an algorithm ?” 

These steps are : 

1 Understanding the problem. 

2. Decision making on 

(a) Capabilities of computational device. 

(b) Choice for either exact or approximate problem solving method. 

(c) Data structures 

(d) Algorithmic strategies. 

3. Specification of algorithm. 

4 Algorithmic verification. 

5. Analysis of algorithm. 




i i- i | uni, snace for n. one unit for i and one unit for sun, 

The V space required for x I ), one unit space 


Algorithm 1.4. Add (*. 

//Problem De.cription = This is a recursive algorithm whig 
//computer addition of all the elements in an array x [ J 
//Input t x [i] is of floating type, total number of elemen, 
//in an array 

//Output : returns addition of n elements of an array 

return Add (x, n - 1)+ x [n] 


> 


The space requirement is 

S{p) Z 3 in + 1) 

The internal stack used for resursion includes space lor formal parameters, local variables a* 
return address. The space required by each call to function Add requires atleast three words (spaj 
for n values + space for return address + pointer to x [ ]). The depth of recursion in n + 1 (n link 
call to function and one return call). The recursion stack space will be > 3in + 1). 

1.12.2. Time Complexity 

The time complexity of an algorithm is the amount of computer time required by an algorithi 
to run to completion. 

It is difficult to compute the time complexity in terms of physically clocked time. For instant 
in multiuser system, executing time depends on many factors such as : 

(/) System load 

(*0 Number of other programs running 
(/») Instruction set used 
(iv) Speed of underlying hardware 

The time complexity is therefore given in terms of frequency count. 

Frequency count is a count denoting number of times of execution of statement. 

1.12.3. Measuring an Input Size 

Hence te°L S n rVed 1 ““JT 1 si2e is lon S er ' then usuall V algorithm runs for a longer lime 
a parameWr SomX 6 ? T'* 5 ' of an a| g°"thm as a function to which input size is passed,- 

1.12.4. Measuring Running Time 

frequency count. The lime which ^meaLrlTfoV ^alyz'^ m , eaSUred in ,erms of a unit callCli 
From an algorithm : yZ '" g algori,hm is g^erally running umt 

We first identify the important operation (core e 

called the basic operation. C an algorithm. This operation ' 


(/,) It IS no. Oiu.cult to identify basic ooera,. 7 

which is more time consuming is a h?J algori,hm Generally the operation 

operation is located in inner loon TV C wpcraC,on ,n algorithm Normally such basic 
comparing the elements and then nh tXd ™ P e ,n sortin ^ a, gorithm the operation which h 
The concept of basic operations cL k ^ u™ 31 appm P rialc Nations is a basic operation 

e wdl und erstood with the help of following example 

^ ^ ^ ® as ' c Operation From Input 

Problem Statement 


Searching a key element 
from the list of n elements. 


Performing matrix 
multiplication. 


Computing GCD of two numbers 


Input Size 

List of n elements. 

The two matrices with 
order n x n. 

Two numbers. 


Basic Operation 


Comparison of key 
element of list. 

Actual muluplicatic 
in the matrices. 
Division. 

»ic operation. We 


(0 Then we compute total number of time taken by this b 
running time of basic operation by following formula. 

(//) Using this formula the computing time can be obtained approximat 

T(n) : 


Running time of 
basic operation 


i the 



Time taken by the 
basic operation 
to execute 

Fig. 1.6. 


Number of times the 
operation needs to be 
executed 


1.12.5. Order of Growth 


Measuring the performance of an algorithm in relation with the input size n is called order o 
growth. For example, the order of growth for varying input size of n is as given below. 

TABLE 1 .2. Order of Growth. 




Fig. 1.7. Rate of growth of common computing time function. 


From the above drawn graph it is clear that the logarithmic function is the slowest growing 
function. And the exponential function 2 n is fastest and grows rapidly with varying input size n 
The exponential function gives huge values even for small input n. For instance for the value of n 

= 16 we get 2 16 - 65536. 

1.12.6. Best Case, Worst Case and Average Case Analysis 

If an algorithm takes minimum amount of time to run to completion for a specific set of input 
then it is called best case time complexity. 

For example ; While searching a particulai element by using sequential search we get the 
desired element at first place itself then it is called best case time complexity. 

11 an algorithm takes maximum amount of lime to run to to completion for a specific set of 
input then it is called worst case lime complexity. jfc 

For example . While seaching an element by using linear searching method if desired element r 
is placed at the end of the list then we get worst time complexity. f 

The time complexity that we get for certain set of inputs is as a average same. Then for - 
corresponding input such a time complexity is called average case lime complexity. 



Consider the following algorithm 


n - IJ. fc« v |. 

This algo? 


Algorithm 1.5. Seq_« ea rch (* |q. 

//Problem Deecrlption , lnla .. . 

//key element from an array x[r) ^ X " for 8ear ching the 
//Input s An array x [0 * ' " n “ 11 sequentially . 

//Output : Returns the YnVeVof VZ "T* ^ 
for 3 0 to n - l do r ® value is present 

if (x [i] = key) then 
return i 

Best Case Time Complexity 

Best case time complexity is a time complexity when an -,1™ ,k 

- ” in se ' ““ ** »“ w. 

^best “ 1 

Worst Case Time Complexity 

Worst case time complexity is a time complexity when algorithm runs for a longest time 
In above search, ng algonthm the element key is searched from the list of,, elements ffheTey 
element ,s present at nth locat.on then clearly the algorithm will run for longest time and thereby 
we will get the worst case time complexity. We can denote the worst case time complexity * 


"worsi 


= n 


me will 


The algorithm guarantees that for any instance of input which is of size n, the running ».., c w„ 
not exceed C wor5 ,(n). Hence the worst case time complexity gives important information about th 
efficiency of algorithm. 


Average Case Time Complexity 

This type of complexity gives information about the behaviour of an algorithm on specific or 
random input. Let us understand some terminologies that are required for computing average case 

time complexity. 

Let the algorithm is for sequential search and 
P be a probability of getting successful search. 
n is the total number of elements in the list. 

The first match of the element will occur at ilh location. Hence probability of occuring firs 
match is Pin for every ith element. 

The Probability of getting unsuccessful search is (1 - P). 

Now, we can find average case lime complexity C avg (/i) as 

C av ( n ) = Probability of succesful search (for elements 1 io n in the list) 

4 * Probability ol iccessful search 



C (/i ) 


— [l +2 + ...- 

n 

P n(n + 1) 




chances of not getting element are po^,^ 
Hence n.( I - A*) 


Thi 

1.1 


C. v ,(«) = 


P(n + 1) , 

— + n ( I + r ) 


i*- « - — - •-* 1 ,or “7:;:rnv^ 

. jsrz -° ”r ssssl * . .» - * — 

0(n + I) 


W> = 


- + n( 1 - 0) 


i 


c.»*(«) = » 

Thus the average case running time complexity becomes equal to n. 

Suppose if P = I i.e. we get a successful search then 

1 (n + 1) m 

C avg 00 = — — + n(l-l) 

(n + 1) 

C avg (n) = 

That means the algorithm scans about half of the elements from the list. 

For calculating average case time complexity we have to consider probability of getting succo 
of the operation. And any operation in the algorithm is heavily dependent on input elements. Thu 
computing average case time complexity is difficult than computing worst case and best case tinv; 

complexities. 

Amortized Analysis 

The amortized time cannot be computed within one execution of an algorithm, rather over i 
sequence of operations we compute the time complexity. There may be a situation that a singU 
operation is expensive but the time taken by sequence of n operations can be better than the wo# 

case time. Hence 


Amortized analysis means finding the average running time per operation over a nwU 

sequence of operations. 


Thus the amortized analysis guaratnees the limp npr . , .* 

“**'.*“* — “p« - wtaii, d.r.r.iL tzzzjti 



of operations. The amortized analysis does not allow ran i ^'i" WC are avera 8 in S over a ^ ucn ‘\ 
case time complexity is calculated by selecting random' in^ornl ‘ 



1 ~ LYS.S OF RECURSIVE ALGORITHM | 

k. 14. MATHEMATIC ana lyzing the efficiency of recursive a lg 0[i . 

“ i,„ of ei, we will see life .l*ori,h m s 

This pl.» ..Us »s “ ' of Alrrori.hu,. 

l. 14.1. General Plan for Analyxlnfl EfHct* 

, . Decide the input size based on parameter n. 

2. Identify algorithm s basic operation (•)• Then find whether the executi^ 

3. Check how may times the basic opt Determine worst, average, and best casei 

s rr — case. . 

4 i ""“ l C ‘ ,n ‘ ,, " 0n "rr" 6 !^ ^h'e 

4. aeiupuicic . . A t of growth. While solving the recunei 

5. Solve the recurrence or atleasl determine ± correctness of form 

we will use the forward and backward substitution method. And then correctness ot torn 

can be proved with the help of mathematical induction method 

Let us analyze 




1.14.2. Examples Factorial (n) 

1. Computing Factorial of Some Number n. 

The factorial of some number can be obtained by performing repealed multiplication. 

For instance . If n = 5 then 
Step 1 : n\ = 5! 

Step 2 : 4! * 5 
Step 3 : 3! * 4 * 5 
Step 4: 2! * 3 * 4 * 5 
Step 5: 11*2*3*4*5 
Step 6:01*1*2*3*4*5 

Step 7:1*1*2*3*4*5 as 0! = 1 

The above mentioned steps can be written in pseudocode form as : 

Algorithm 1.9. Factorial (ji) 

//Problem Description s This algorithm computes n! using 
//recursive function 

//Input s A non negative integer n 
//Output : returns the factorial value, 
if (n = 0) 
return 1 

else 

return factorial (n - l) * n 
Mathematical Analysis 

Step I : The factorial algorithm works for input size n. 



f* ! ‘ ™! Tf h factorial la „„i p ,| CKio „ 

S1 ,p J r The recursive furucrion call „ he !„r,„„l« d „ P 

F(n) = F(n - 1 ) » „ 

Then the basic operation multiplications is piv^n « ,,, a * Where n > 0 

compute factorial (n). ‘ (”)• And M(n) is multiplication count to 

M(n) = M( n _ j) , . 


These multplications are required lo 
compute factorial (n - 1 ). 


To multiply factorial in - 1 ) by n. 


Step 4 : In step 3 the recurrence relation is obtained. 

Min) = M( n - 1) + l 
Now we will solve recurrence using 
Forward Substitution 

Af(l) = A/(0) + | 

Mil) = W(l) + 1 a l + i - 2 
M{3) = A#( 2) + 1 = 2 + 1 = 3 

Backward Substitution 

Min) = A/(n - 1 ) + 1 


= M(n - 2) + I 


+ 1 = M(n-2) + 2 


= [M{n - 3) + 1] + 1 + 1 = M(n - 3) + 3 
From the substitution methods we can establish a general formula as : 
Min) = Min - i) + i 


Now let us prove correctness of this formula using mathematical induction as follows : 

Prove Min ) = n by using mathematical induction. 

Basis : Let n = 0 then 

Min) = 0 

i.e. Mi 0) = 0 = n 

Induction : If we assume Min - 1) = n — 1 then 
Min) = Min - 1) + 1 
= n - 1 + 1 
= n 

i.e. Min) = n 

Thus the time complexity of factorial function is 0(n). 

1-14.3. Example : Fibonacci Number* 

This series is identified by European Mathematician Leonardo Fibonacci in 1202. The F.bonacc. 
numbers are given by following series. 




i.e. previous two nu 


l ' b e obtaine/by following formula 

numbers are added to genera 


This series can dc _ ' + f(n _ 2 ) 

f(n) - f( erale curr ent number. 


where n > i 


initial conditions. 


There are two 

Fib(O) = 0 


Fib(D = 1 . be shown diagrammalically as, 


This recursive detinition 


of Fibonacci series can 


Fib(5) = 5 


Process this 
branch first 



Fib(O) 



Fig. 1.8. Recursive calls made to obtain nth Fibonacci number. 


Algorithm 1.10. To obtain nth Fibonacci number 

Algorithm Fib (n) 

//Problem Description s The algorithm finds the nth 

//Fibonacci number 

//input t The number n for which the value of Fibonacci aerii 
//is to be obtained. 

//Output : The nth Fibonacci number is returned, 
if (n <- 1) then 
return n 
x <r - Fib (n - l) 
y <- Fib (n - 2) 
return (x + y) 





where a, b and c are real numbers and a *0. This type of recurrence is of second order because *(, 
and x(n - 2) are two positions apart in the given sequence. This sequence is called linear becai 
L.H.S. contains linear combinations of unknown terms. If F(n ) - 0. then sequence is ca 
homogeneous otherwise it is called inhomogeneous. And as a. b, c are some constant terms appearing 
in (he sequence this sequence is called with constant coefficients. If the sequence is homogeneous, 1 
then 

our(rt) + bx(n - 1) + cx(n - 2) = 0 **'^i 

The solution to this equation (2) can be obtained by using quadratic equation. 


ar 2 +br + c =0 "*( 3 ) 

This equation (3) is called characteristic equation. 

Now to obtain formula for nth Fibonacci number we will rewrite equation (1) as, 

F(n) = F(n - 1 ) + F(n - 2) 
i.e. % F(n) - F(n - 1 ) - F (n - 2 ) = 0 

The characteristic equation for above equation is, 
r 2 - r - 1 =0 

We can solve the quadratic equation by finding its roots. 


-b ± yjb 2 - 4 ac 

The formula for finding roots of quadratic equation is — 

1.15. SEARCHING ALGORITHMS 


i 



Worst Case 

Average Case 

Best Case 

Linear Search 

0(n) 

0 (n) 

0(1) 

Binary Search 

0(log 2 n) 

0(log 2 n) 

0(1) 


s 


NOTE 


d 


Binary search is better than linear search for worst case and average case conditions. 
But for binary search the elements should be first arranged in ascending or decending 
order. This involves an extra effort. On the other hand, for a sorted array, if linear search 
algorithm is used, there may not be much improvement in the performance. 


1 . 16 . SORTING ALGORITHM 


F 

Worst Case 

Average Case 

Best Case 

[Bubble 

0(n 2 ) 

0(n 2 ) 

— 

Insertion 

0(« 2 ) 

0 (n ) 

0(n) 

Section 

Of/. 2 ) 

0(/T) 

j 

1 

0(n 2 ) 

0(n log n) 

0 (n log n ) 



EXERCISES 


Wha. is an algorithm ? Explain various crit 
2. How do you say one algorithm is better , ha „ 

J. dm,,. *"»*" pron„„ s 

4. Differential. between prtoti “ ” f 

y ‘ and postcnori analysi 


Jsed for judging 
•ther algorithm i 



algorithm. 

solving the same problem ? 


questions with 


answers 


Q. 1. What is an algorithm 


and can be 
rithm must 


Ans. An algorithm is a finite sequence ofil?""" 3 USe<1 ,or J ud g>ng an algorithm, 
performed with a finite amount of effort in? r"*' ° f Which has a clear me anm 
satisfy the following criteria (norms) fir " te Cnglh ° r ,,mc In addlllon . the al 

(0 Input : No input or more data items are supplied 
(ii) Output : At least one data item is produced 
m Definiteness : Each instruction is clear and unambiguous. 

' V teminateT ^terTfi^num^ ° f a,g0n,hm ' lhen f ° r a " cases ' ^onthm 

<V) e m n U ol b b e ,h b T C ? ' ha ‘ 3 PerS °" “ Sing <*"*' a " d P a P- - 

also must be feasible ' ® CaCh ° peration is deflnile as in criterion (3); it 

Q. 2. How do you :,y one „ bene, s „ |vm| , ^ . 

space complexity and time complexity. 

Q. 3. Differentiate between profiling and debugging. 

Ans. Testing a program consists of two phases : debugging and profiling (or performance measurement) 
Debugging is the process of executing programs on sample data sets to find whether wrong 
results occur and, if so, to correct them. Debugging can only point to the presence of errors. More 
than one programmer can develop programs for the same problem and verify the output with 
different input data sets. 


Profiling is the process of executing a correct program on data sets and measuring its time and 
space. These timing figures are used to confirm the previous analysis and point out logical 
errors. This way, we can optimize the performance of algorithms. 

Q. 4. Differentiate between priori analysis and posteriori analysis. 

Ans. In order to choose between data structures and algorithms, the efficiency of competing data 
structures (in terms of space required) and competing algorithms (in terms of time used) must be 
compared. The best test of a data structure or algorithm is to measure its efficiency. This is called 
a posteriori (after the fact) analysis. Since the choice of a data structure or algorithm is generally 
made before a program is written, a priori (before the fact) analysis is necessary. 

The priori estimates refer to performance analysis and the posteriori analysis to performance 
measurement. A frequency count of statements executed is the most direct form of a priori 
analysis of the time used by an algorithm. A frequency count of data structure elements used is 
the most direct form of a priori analysis ot data structures. 


i. 5. Find complexity of the following loop_ 

con.id. th. following loop 
for i — » 1 to m 
{ 

P ( i ) 

) , . . . ic pa\ If we consider that the ex 

„ *, iype oc '1- P*— “ i „ 

, lm , „ „„ „ w ^ “ h 

m „ : Generally .. He »• =•«»•" ““ 

m 


So total time = Y0(1) = ©I 1 =®< m) 


So the time complexity is 0(m). 

Q. 6. Find complexity of the following nested loop ? 

for i <— 1 to m 

{ for j «- 1 to m 
{ 

P ( i j ) 

) 

) 


Ans. Time complexity = £ £©(1) -0(m 2 ) 

,x| i=l 

Q. 7. Consider the following loop and calculate the total computation time 

for i <— 2 to m - 1 
{ 

For j «- 3 to i 
{ 

sum <— sum ♦ A[i] [j] 

> 

) 

m-\ l m-l i /n-1 

Ans. Total computing time = X X**J 1 = X X®^ = X®^ 

■ i=2 J = 3 i = 2 7=3 i=2 


= 0 


!<o).e (4 


+ 0(m) = 0(m 


( OBJECTIVE TYPE QUESTIONS 

1. The step-by-step description of a process is called as 

(a) Algorithm ( b ) Pseudocode 

(c) Flowchart ( d ) Program 



3 . 


. Rer,ncd vcr ' ,on « ^, n 
(h) Ungua * e "dependent codp 
(c) Outcome of compilation prot 
id) Code developed using , he ' 

Experimental methods arc u-, c d " ** 

(a) Performance analysis ^ ° 

(b, Performance measurements 
(r) Efficiency 

“ P " ,0 ™“'“ ■">'» .« e, rtmmc . 

The »mpone„„ of llme 

(o) rhe compiler used 

(c) The computer options 

“ “ 7 “"- ih « «»,. „ 

7 7“*““’ ■« '« **«,„. the peer,,™, 

(fl) Analytical ^ ^ 

(O Analytical the theoretical 


The t 

’get co 
nee o! 
Analy 
Exper 
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Growth of Functions 


- (iNSIC 


INSIDE THIS CHAPTER 1 


2.1. Asymptotic Notations 

2.2. Some Operations on Asymp- 
totic Notations 

2.3. Maximum Rule 

2.4. Big-oh Rules 


coming sections. 


Asymptotic Notations is used to describe the running 
time of an algorithm. This shows the order of growth of 
function. We can map the time taken by an algorithm in 
terms of mathematical function. For example an algorithm 
taking rC microseconds can be thought of “of the order of 
n , as unit is constant. Asymptotic notations are 
mathematical way of representating “order of’. We have 
many asymptotic notations like 0, O Q, to, o described in 

^.1. ASYMPTOTIC NOTATIONS 

There exists an algorithm for every given problem in the world, and this algorithm should 
always be analysed by calculating its total time complexity />., total time required by the algorithm 
to execute itself. This time complexity is always calculated and it depends on the following : 

(a) Total number of inputs in the algorithm. 

( b ) Total number of comparisons 

and it always generated in mathematical form. But if we want to represent the time complexity ii 
term of algonthm, then some notations are used called asymptotic notations, where asymptotically 
indicate that the time is exactly equal to given time i.e., it is tightly bounded. 

Asymptotic notation are further catagorized into the following five notation* 

total time complexity of an algorithm. 8 notat,oni depending 

(a) Big Oh (‘O’) 

( b ) omega (‘Q‘) 

(c) theta (‘0’) 
id) little Oh ('o') 

(e) little omega (‘(o’) 

2.1.1. Big Oh Notations 

This notation always generates the 
algorithm. 


on the 


worst time or the maximum time required by a particular 


32 






time function f(n) 


where /(") and g(n) are th7 functioiTtTrT 7 lc ~/ (n > - C.g( n) V n > n „. I 

‘C is any conslam and n n are the m 

should have lesser or equal value comparedtoC ° f elemen,s such that ti 

Big Oh VO') notation is also known as a * "*■ 
and can be represented graphically using Fig *™ pt0,lcal| y u PPer bound 

Example 2.1. If 3„ 

Solution. We have 3n + 2 < 4n V n > 2 
ThUS *(") = C = 4. „ 0 - 2 

Example 2.2. If 10„‘ . 4»77I^VS^ 

Solution. We h„e . Ia ,> . 2 s , y 

Thus o( n \ _ .2 r . *ig. 2.1. Asymptotic function 

gun - n ,c = 11, n 0 = 5. graph :/<„) = 0 ,g<„>, 



Example 2.3. If/(„) = 6.2" + „ 2 = O^TU^g^. 

Solution. We have /(„) < 7 . 2 " v n > 4 
Thus *(«) = 2", C = 7, n 0 = 4 

2.1. 1.1. Running Time of an Algorithm 

The running time.in general can be in the following order 

0(1) < 0(log 2 n ) < O(rt) < 0(n log n) < 0(n 2 ) < 0(n 3 ) < 0(2") 

Function Values 


Ig n 

n 

n Ig n 

n 2 

n 3 

2" 

0 

1 

0 

1 

1 

2 

1 

2 

2 

4 

8 

4 

2 

4 

5 

16 

64 

16 

3 

8 

24 

64 

512 

256 

4 

16 

64 

256 

4096 

65, 536 

5 

32 

160 

1024 

32768 

4,294,967,296 



2" grows very rapidly. See Fig. 2.2. 


Fig. 2.2. Shows approximate 
plot of functions 



2.1.2. Omega Notation 

This notation always generates the best time or the minimum lime required by any 

a lgorithm. 


f(n) = £2(g(n)), there exists some constants C > 0 for which 0 < C.g(n) </(n) ”o 
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I grow 



ihe minimum nm 

mbcr dements 


Jr 


minimum number of elements su ^ C gin). / 

have greater or equal values compart nptollca lly lower bound ] 

Omega notation (Q) *» a,M) no * n ^ ^ | oW cr time and can be 
as the lower value i.e.. K (n * ,s '* c * 1/ ; 

represented graphically usin^. 11 I 

Example 2.4. If in + 2 = Q<"). find «<«>• ^ ( tumctiom 

Solution. We have 3 n + 2 2 3n V n S I graph ./,*> * Q</o»» 

Thu« tin) = «.C = 3.»„- 

Example 2.5. If 10n* + 4n + 2 = Qin 1 ), find gin). 

Solution. We have I On’ + 4n + 2 2 I On • " - 1 
Thus *(«) = "■ C = 1°. n n= I 

ExampleT.67 if / wT^2" T7To( 2n >’ n " d * {n) - 
Solution. We have fin) * 6 - 2 " v "-' 

Thus *(") = 2". C = 6.n 0 = I. 

2.1.3. Theta Notation c 2 q ( n) 

Theta notation ( ‘0’) always generates the average time or the time / ^ 

between maximum i.e., big oh CO') and minimum i.e.. omega < « ) / / c lfl 

required by any algorithm. J / / 

fin) = Sigin)), there arc two constants C, > 0 and C 2 > 0 tor 

I which 0 < C,g(n) <f(n ) < C 2 gjn) V n > n Q J 

where /(«) and gin) are the functions of lime. F(n) is the actual time 7/T 

while gin) is the lime between minimum and maximum C is any ■ 

constant. n 0 is the minimum number of elements for which theta (0) p. g 2 4 Asymptntic 


Solution. Since Sigin)) is a set and f(n) is its member by definition. We can assume gin) = n 


This notation is also known as asymptotically tight bound as fin) 
is lightly between C,g(/i) i.e., minimum and C 2 g(n) i.e.. maximum 
and can be represented graphically using Fig. 2.4. 


generates average time. 


function graph : 
/ (n) = 8tg(n)) 


i.e., maximum 


Example 2 . 7 . fin) = - 3 n, find 0 notation. 


C,n 2 < ~n 2 - 3n < C 2 n : 


C, 


iC 


n 


n 



growth of functions — _ 

— __ _ ca 


Since C 2 is +ve constant. C 2 have maximum value ~ as 


vc term is subtracted 


and 





i -2 = -1 

2 n 14 


C, < 


14 


is 


Hence, lowest value of V for which f(n) lies between C ]g (n) and C 2 g(n) is #i 0 = 7 

Hence order is 0O 2 ). 


Example 2.8. Find ©-notation for \n 3 +|/i 2 + -n. 

j 2 6 


Solution. Let 


Let 


/( „ ) = i„3 + i n : + I n 

< C 2 n 3 
g(n) = n 
fin) < C 2 g(n) 

fin) = 0(n 3 ) 


Theorem 2.1. If fin) = a 0 + a } n + ... + a m n m is any polynomial of degree m or less, then 
fin) = Q(n m ) 

Proof. We have 

| f(n) | < | a 0 | + |o,|n + |a 2 l " 2 + - + I I 


r W + j£iL + ... + k 

K n m n m -' 

= (|a 0 l + l fl |l + "• + |a ™ |) "”"- 1 


C 2 

f(n) 


= U 0 l + I a i l + 

< C 2 g(n) where g(n ) = n m . 


When n= 1. 


2.4. BIG-OH RULES jf ^ (> drop lower-order term,^ 

(a) If f(n) is a polynomial of degree A, tneny 

constant factors. ^ jg jnstead 0 f “2« is 0(n 2 )". 1 

<« Use the smallest possible class of fun V Qf ^ + 5 js Q 


2.4.1. Running Tim* of Algorithm Uaing O-Notntion 

In computing, we categorize the algorithms according to then asy mptotic categoric! 

The run-time behaviour of most algorithms falls into one of on y a ou sc classes# 

0(1), 0(log «), 0(n), 0(n log n), 0(« 2 ), 0(« 3 ). 0(2")- These are known as complexity classes, 

asymptotic growth classes. 

TABLE 2.1. Basic Asymptotic Efficiency Classes. 

Name of 
Efficiency 
Class 

Order 

of 

Growth 

Description 

Example 

Constant 

1 

As input size grows then we get larger 
running time. 

Scanning array elements. 

Logarithmic 

log n 

When we get logarithmic running time 

then it is sure that the algorithm does 
not consider all its input rather the 
problem is divided into smaller parts 
on each iteration. 

Performing binary search 

operation. 

Linear 

n 

The running time of algorithm depends 
on the input size n. 

Performing sequential search 
operation. 

n log n 

n log n 

Some instance of input is considered 
for the list of size n. 

Sorting the elements using merge, 
sort or quick sort. 

Quadratic 

2 

n~ 

When the algorithm has two nested 
loops then this type of efficiency 
occurs. 

Scanning matrix elements. 

Cubic 

3 

n 

When the algorithm has three nested 
loops then this type of efficiency 
occurs. 

Performing matrix multiplication. 

Exponential 

rUPlnri a 1 

2 n 

When the algorithm has very faster 
rate of growth then this type of 
efficiency occurs. 

Generating all subsets of n elements- ; 

* luridl 

n! 

When an algorithm is computing 
all the permutations then this type 
Of efficiency occurs. 

Generating all permultations. 

' 
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(«ou/ed examples] 


Example 2.17. In + 10 is Ofa) 

Solution. By O-notation, we need to n„ . 
that a to r,nd a real consta 


2* + 10 $ Oi 

2n +\ 0 £ Cn 
( C-2)n ^ 10 


01 ( > ® aru * an integer constant « 0 > 1, such 


n £ 


10 


(C-2) 


A possible choice is C = 3 and n 


Example 2.18. n is not 0(n ) 

Solution. 


10. This is one-to-many choice 


* < Cn 

_ . . .. n < C (after dividing by n on both sides) 

Th.s inequality cannot be satisfied since C must h e a constant. 

Example 2.19. (i i + l) 2 = 7 2 + 2„ + i is 0 (n\ 

Solution. („ + i)2 < Cn 2 

This need C > 0 and n 0 > 1 such that 

(n + l) 2 < Cn 2 for n > rt 0 
This is true for C = 4, n 0 = 1 i.e., 

3(21) 3 + 20(21 ) 2 + 5 < 4(2 1) 3 
36608 < 37044 


Example 2.20. log n + log log n is 0(log n). 
Solution. This needs C > 0 and n 0 > 1 such that 

log n + log log n < C log n V n > n 0 . 
This is true for C = 4, n 0 = 2 i.e., 

log (2) + log log (2) < 4(log (2)) 

1 + log (1) < 4(1) 

1 +0 < 4 


[as log 2 2=1] 


Example 2.21. f(n) = 3/i 2 + In - 5. 

Solution. For large values of n.ln — 5 is insignificant compared to 3 n 2 , so we would except that 
f(n) is 0(3n 2 ). In fact, since constant multiplies are not significant, we expect that f(n) is 0(n 2 ). 
We could note that for n > 1, 7n - 5 > 0 and so 3 n 2 + 7/i - 5 > 3rt 2 . And we could note that for 


n > 7. 


3n 2 +7n-5 ^ 3n 2 +7n<3n 2 + n 2 <4n 2 

3(7 2 ) + 7(7) - 5 < 3(7) 2 + 7(7) < 3(7) 2 + (7) 2 < 4(7) 2 
191 < 196 < 196 < 196 




So, we have taking g(n) = n 2 , that 3 gin) <f(n) < 4 g(n) V n > 7 

Taking n 0 = 7, C, = 3 a n d C 2 = 4 in the definition, we have proved that f(n) is ^ - 

Example 2.22. Prove or disprove 


(a) 

2" + l =0(2") 





i b ) 

2 2 " *0(2"). 





Solution, (a) 

fin) 

= 

2«+t 




<2^n 1 

< 

C.g(n) 




2« + i 

< 

C.2” 




2^ + 1 

£ 

2.2" 


if 


C 


2 then 2n + 1 

= 0(2”) 

(b) 


fin) 

= 

2^" 




2 2n 

£ 

C.g(n) 




2 2n 

< 

C.2” 




2 2n 

< 

2" .2" 


if 


c 

> 

2" then 2 1 " = 

0(2”) 


Proved. 


where gi n ) " 2 
where C = 1 

where gin) = 2 
where C = 2 


which is not possible as C depends on the value of V which is not a constant value, hence 2~ n * 0{2 n ). 


Example 2.23. Prove the following : 

(a) n ! = 0(n n ) 

(b) log (n!) = 0(n log n) 

(c) 1* + 2* + .... + n k = 0(n* + I ) 

(rf) 1 + 2 + .... + n = 0(n 2 ). 

(e) (n + a) h = 0(n h ) 

Solution, (a) /(") = n! 

n\ = n(n - 1) in - 2) .... 1 
n\ < C.g(n) as big-oh notation. 
n{n - 1 )(n - 2) .... 1 < C.g(n) 

n(n - 1 )(n - 2) .... 1 < n . n . n n times 

n\ < n 

Hence n! = 0(n"), C=l.n 0 =l Proved. 

(b) /(») = >og (»!) 

n! = n(n - l)(n - 2) ... I 
log (n\) < C.g(n) as big-oh notation 

, og [„ ( „ _ 1 ) (n - 2) .... 1] * log I" ■ n. n n tiroes] 

log ini) ^ log («”) 

log (/i!) £ n log n 




Hence fin) 

1 = Oin k * } ), c = 

5 1 , n 0 =| Proved. 

( d) 

fin) 



fin) 

^ C.%(n) 


\ + 2 + .... + n 

Z n + n + .... 4. „ 



£ n . n 



^ w 

Hence / ( n ) 

= 0 (n 2 ) t C = 1, 

*o = 1 Proved. 

ie) 

fin ) 

— in + 1 )b 


fin) 

= OK*))* suppose 


gin) 

= * + 0 


gin) 

- C‘gin) as big-oh 


n + a 

^ n + n Vn 0 >| fl 


n + a 

£ 2n 

Now 

fin) 

£ C.£(/i) 


in + a) h 

< (2n)* 

^ h 


Hence ( n + a) h = 0(n h ) y C = 2/>, n 0 -\a I. 


Example 2.24. Prove that ^- = cd(/i). 
Solution. We know that 


lim 

n— 


fin) 

gin) 



— oo 


Thus, we say 


— = c o(n) 


Example 2.25. C,n 2 + C 3 /i £ C 3 n 
Solution. If C, = I. C 2 = 2 , C 3 = 1000 

=> w 2 + 2« < 1000m. 

„ 2 < 998 n n < 998 

No matter what the value C v C 2 , 
complexity C 3 /> will be faster than the one 


lakes, there will be n beyond wh 
with C t n : + C>. This value on i 


the algorithm vtith 
lied the break-even 



algorithm analysis and 



i triihm with complexity C,rt will always be fi 
point II break even point is it ro. then the algor 

(or at least IB fa*t) 


Example 2.26. (/) Prove 3n + 2 = oin 


Solution. 


U 


Thus, oin ) holds. 

Example 2.27. Prove that Ig (n !) = Oin Ig n 

Solution. n ! * n(n - I) (n - 


Taking log of both sides, (To the ha 
Ig n 


n , n 
2*2 


= |flga-lg 2 2) 

= yflg a - 1) = y log n 

<n\%n. 

= Oin Ig n) 


Example 2.28. Prove 2" * 1 = 0(2"). 

Solution. By formula 

jn + i 

lim = 2 

n— »« 2" 

/(«) = 0(2") 

Example 2.29. (n + «)» = e./hTToTa and b are real constants 
Solution. /(„) = n' , [l + ^j" 

gin) = n b 


u 


I = constant as 


if Lt ^ = constant 

£(/i) 

^ en fin) = Q( /?(*?>) 


0(n <> ) holds. 



Example 2.30. Prove „ ; = 0(n „ | 


Solution. We have 


n ! - 

= '*'11 


n{n ~ I) ... 3.2.1. 

V\ 3 2 I 


Lt 


g(n) 


— V n ) n n n 


Lt ri n 


n\ = o(n n ) 


Example 2.31. Prove lg = e ( „ , g 

Solution. We have fo n \ - „ /o , , w 

8 . - n lg (n/ e ) f rom siirlincs’ 


= n Ign - n lg 2 € 

Lt _ n lg n - n lg e 

g{n) Lt n jg n 

= i-|^=i 

lg n 

*’’ lg nl = 0(/i „) 

Example 2.32. Prove « ! = cdU"). 

Solution. We have = 00 for f (n) = a )(g(n)) 

=> We can write, 

7t - 


tirlings’ approximation 


Lt (as log « 


Applying 
Using L’ Hospitals Rule 


n! = n 

= nlJi) 

-h» g(n ) 2 n l 2 J 


Lt 

g(n) 


n n nn n - 1 


Thus 


n ! = cu(2 n ) 



Hence it holds. 





By L' Hospital Rule 


f(n) 

= “7 = Ll 

g(n) 

n a 

1 

f'(n) 

1 

n 

g( n ) 

le 

In 2.a.n 

fW 

hrn — — 
gin) 

= Lt :L T7-T 

n-4« g M 


In 2 .< 


Lt 


n a In 2 n a a In 2 . « 

I ! 


= 0 




.-. /e 0(g ) proved. — — 

Example 2.34. Prove that * e <" lo S "> 

n 

Solution. Let /(") = 

= log 1 + log 2 + log 3 + log 4 + ... + log n 
- log 2 . 3. 4... n, as log I = 0. 

= log (n - I ) ! 

< log n ! 

But log n\ = 0(n lg n) 

f(n) e 0(n lg n) proved 

^ Note : log 1 is zero to any base. 

Example 2.35. Compute x", write an algorithm and improve its running time. 

Solution. 

, Power <— x 

For if- 1 to n - 1 do 
Power <— Power x x. 

This algorithm takes 0 (h) time. 

We can modify this algo to reduce the runtime, Let 2 K = n, s.t. K - lg n y 

then, 

Power <— x. 

for i 1 to k do 
Power = Power 2 

This algo, executes in 0(log n ) time this is significant improvement over the previous algor 




Example 2.36. What does all this mean? 

3 n - lOOrt + 6 = 0(n 2 ) because 3 h 2 > 3 n 2 - IOOai + 6 
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3n 2 - 

100 n 

+ 6 * because Ol/i' : 

3n 2 - 

100 n 

4 6 * Oin) because r.n < 3 

3 n 2 - 

lOOn 

4 6 = U(/i 2 ; because 2 99 

3 n 2 - 

IOO/i 

+ 6/ Qf/i 3 ) because 1 2 

3n 2 - 

lOOn 

+ 6 = tu n ) because 10 

3n 2 - 

lOO/i 

+ 6 « Ofn*) because O \ 

3n 2 - 

100/? 

♦ 6 * 0(/i 3 ) because O * l 

3 n 2 - 

MX)// 

+ 6 * fK/i) became n , • 


Note that 

log (n + n 2 + n + 96) = Oiloy n\ 

n + n 2 + n + 96 = () (n 47 *) and 
Since log n 471 = 473 • log n 

Any exponential dominates every polynomial Th 

time algorithms. 

Example 2.37. For each function /(„) and time /in (he f„ll,,«»nw t 
me n of a problem that can be solved in time / assuming that I 
problem takes /(/») microseconds. Recall that log n denotes the 
Some entries have already been completed to get you started. 

Solution. The numbers in the first row are quite large. The table below 
in powers of 10 . People might also choose to use powers of 2 Being cl 
for the big numbers (within a few factors of 10 from the answers shov 



1 Second 

1 Hour 

log n 

2 106 *.io 300000 

23 6 x I0 9 ^ 

V/I 

* 10 12 

* 1.3 x I0 1 

n 

10 6 

3.6 x 10 9 

n log n 

* 10 5 

* I0 9 

n 

1000 

6 x 10 4 

n 3 

J00 

= 1500 

2 n 

19 

31 

n\ 

9 

12 


Example 2.38. Show that n 3 log n is Q(n 3 ). 

Solution. By the definition of big-Omega, we need to find a real constant c > 0 and an integer 
constant n Q £ 1 such that n 3 log n > cn 3 for n > n Q . Choosing c = I and /i 0 = 2. shows n log n > cn 
for n £ n 0 , since log n > 1 in this range. 

Example 2.39. An array A contains n - 1 unique integers in the range [O, n - 1 1. that is. there 
is one number from this range that is not in 4. Design an OtnMime algorithm for finding 
Uiat number. You are allowed to use only 0(1) additional space besides the array A itv 





7. Let/(rt) ami *(«) be asymptotically non negative functi 


prove or disprove. 
8. Prove or disprove : 


9. 

10 . 


(0 0 ( 2 U> *° *) = 0 ( 2 u ’ t “ ") 

(ii) If a < b then n a l 2 n £ 

Suppose we have n total elements divided into m sorted 
sorted list of all n elements in time 0(n Ig n). 

A computer performs I0 y operations per second, what ,s 
hour if our algorithm lakes 3" operations on problems o 


( plain how to produce 

!S , problem you can sol 


a 

ve IQ | 


n . 

11. Prove = 

i=i L 

12. Show that 2 n + 1 is 0(2 n ). 

13. Show that n log n is Q(n 3 ). . t : always m 

14. Show that \f(n) \ is 0(f(n)) is /(n) is a positive nondecreasing 

than 1. . 

15. Define omega notation. Explain the terms involved in it Gi\e . 

16. Write the non-recursive algorithm for finding the Fibonacci sequence 
complexities. 

17. Consider a polynomial in n of the form 


f(n) = = a «"" +a " 


| n m 1 + a 2 n 2 + a t n + a n where a m > 0, 


then / ( n ) = Q(n m ). 

18. Show that /,(«) x/ 2 (n) = 0((g t (n) x g 2 (n) where /,(«) = 0(g,(n)) and f 2 (n) = 0(.g 2 (n)). 

19. Prove that/(n) = 0(h(n )) where/(n) = 0(g(n)) and g(n) = 0(h(n)). 


(questions with answers 


Q. 1. 
Ans. 


For the given x and /?, write an algorithm to compute x n /ri\, and compute the running time. 


/(") = ^7 = f x t x t x •>< 


£ 

2 


x_ 

3 


Algorithm (x, n) 

1. fn=x 

2. For k = 2 to n do 

3. fn = fn * xJk 

4. Endfor 

5. Return fn 




j GROWTH OF FUNCT IONS 


Lint- 1 and linc-.S count for 

(one multiplication, one di vi . * UnU each * Line 

total of 3(n - I ) units. Line 7 k ,0n ’ and ° nc assi 

k. The total of all these is i ,, * hc h,dden costs 
On Th..v to initialize, n 


•ounts f 
,c nt) an 


is 2 n. Thus, the run time of ihi G i 

1 m,s algorithm is 

Q. 2. Define omega notation. Explain the 
Ans. Omega-notation provides an asvmm, . , ' 

m ,S Q( *<"» if are posL^co^ 


►Sts of ir 
ill the te 


thr 

id is t 


ivolvet 


0 and n 0 > 
f (n) > co(n) fn 11 

For example, let ( * r d n% n * 

Since with < = I and for n > „ = -> " V" ~ a " d 

o We have 2n“ + On — in > 
Verification : 2(2 2 ) + 7(2) - | 0 > U2 2 ,. 


“e units 
xecuted 
sting k ^ 
for all t Y 


per times e 
n - I time 
n, and incre 
ie increment 
2n = 5/» - 1 


xccuted 
s, for a 
meriting 
s, which 


8+14-10 = 12 >4. 

Hence, fin) > cg(n). 


Q. 3. 


Write the non-recursive algorithm 
complexity. 


for finding the Fibonacci 


iequence 


and 


tim 


Ans. Algorithm (n) 

1. /, =0; f 2 = 1 

2. print f,,f 2 

3. for i = 3 to n do 

4- / 3 =/,+/: 

5. print / 3 

6 . /, =/ 2 

7 . h =/ 3 

8. Endfor 

9. Return 


Count of primitive operations 
2 
1 

I + (n - 2) + (n - 1) 


2(n - 2) 
(n - 2) 
(*- 2 ) 
(fl - 2) 


Total number of primitive operations = T(n) = On - 9 —> O(n). 

Q. 4. Write an algorithm to compute x n for any real number x and integer n (where n is an integral 
power of 2). Prove that the running time of this algorithm is @(log 2 n). 

Ans. Algorithm that computes x n for any real number * and integer n (where n is an integral power of 

2 ). 

Algorithm (a\ n ) 

1 . k = log, (n) // If n = 8 (or 2 3 ), then k = log 2 (8) = 3 

2. y = x 

3. for i = l to k do 

4. y = y*y 

5. Endfor 

6. Return y 



, hen * = log, («>. Henc 
I ami coin). 
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the running time of this algorithm ^ 


If n = 2 k for some integer 
0(log 2 n). 

Q. 5. Derive the function /(n) = ,2 " + ,s 
Ans. The function /(n) = o(g(n)) if and onl> if 

f(n) _ q 
g(n) 

f( tl ) = 12/i 2 + 6/i and t,’(/i) = n 


lim 


lim 


+ 6 ' 1 = o. and also/<«) < cg(n). 


••/(„) = „(*<„))" means for all c > 0 there exists some n 0 > 0 such that 0 </<») < < «(") lor all - 
For nil and r = 2 ,f(n) = I2n : + 6n = 630. and cg(n) = In = 686. 

Hence. f(n) = 12n 2 + 6n is o(n). 

The function f(n) = <o(g(n)) if and only if 

lim ^ =0 
„_»• f(n) 

f(n) = 1 2/i 3 + 6 n and g(n ) = /» 

= 0 and also f(n) > cg(n). 


lim 


n -»°° 12/i -f 6/i 

For n > 2 and c = 18, f(n) = 12(2 2 ) + 6(2) = 60, and cg(n) = 18(2) = 36. 

Hence, /(/i) = 12/i 2 + 6 n is co(/i). 

Q. 6. Show that /» 3 log n is a)(n 3 ). 

Ans. Let f(n) = n log 2 n and g(n) = n~ 

f{n) is 0)(g(/t)) if and only if there exist positive constants c and n 0 such that f(n) > cg(n), for; 
n>n 0 . Alternatively,/^) is d)(g(/i)), if and only if 

lim M = - 
g(n) 


lim 

n — >°e 


n 3 log 2 n y . 

3 °&2 n ~ °° ^ or su ^iciently large values of / 


Hence, n' log 2 n is tu(/i 3 ). 

Q. 7. Consider a polynomial in n of the form 

m 

fin) = / a. n ' = a n m + n ^ - 1 . 2 

£0 m m ~ ]fl + a 2"~ +fl|R + fl 0 where a m > 0 , 

lhen/(/7) = «(„ m ). 

Ans. Consider a polynomial in n of the form 



I gbowth of functions 


/(n) = 2>,n' 

f(n) s 


£ la >‘ 


m is added and subtracted 


>o the power of n. 


I"' m n n 


~ n " X la » , ' ,, "' n 

i-0 

- n [l a ol« " +la. In 1 '" +|a 2 1,, 2 -” + + | a j n m-».] 

- »’ [la 0 I + lo, I + |fl 2 | + ... + id" | x l] 

n Vl ' uc are neglected for n > 

m 

< n m ^ \a, I 

i-0 

Hence, f(n) = 0(n m ) assuming m is fixed. 

Q. 8. Show that/(n) + g(n) = 0(; i 2 ) where / (n) = 3« 2 - n + 4 and g(/i) = n log n + 5. 

Ans. Show that / (n) = 4n 2 - 6n + 288 = Q(n 2 ). 

Given functions /(n) and g(n), we say that / (/i) is Q(g(n)) if there are positive constants c > 0 < 
n 0 > 1 such that 

/ ( n ) = 4n 2 - 64n + 288, and g(n) = n 2 
This is true for c = 1 and n 0 > 15 — » 4(15)" - 64(15) + 288 > 1(15"). 

This is 228 > 225. Hence, f(n) = 4 n 2 - 64/i + 288 = ft(n"). 

Q. 9. Show that f { (n) xf 2 (n) = 0(( g] (n) x g 2 (n)) where /,(n) = 0(£,(/i)) and f 2 (n) = 0(g 2 (n)). 

Ans. For aJl n > \J x {n) < max(g,(/i), g 2 (n)) and/,(/r) < max (g,(n), g 2 (n). 

Therefore, /,(n) + / 2 (n) < max(g,(/i), g 2 (n)) + max (g,(/i), g 2 (n)) 

/,(*) + / 2 (w) < 2 max (g,(n), g 2 (n)) [By definition. f(n) < cg( 

Thus, Mn)+f 2 (n) = 0(max(g,(n). g 2 (n)). 

Q. 10. Let /(«) and g(n) be asymptotically non negative functions, using the baste definition of 

notation prove that 



A ns. max 




< max </(«) + g< n 


)) <, C, (/ (n) 


rj|) for 311 


Let us take C, = ~ • 1 


two situatio 


! /(«)>#('>)=* -(/('*) + 2 




1 , = f(n) = ms 

(/(/i) + / WJ J y 


{ J ( n) 


2 .f(n)<g{n)=> 2 ^ 

Now let us take C 2 = 1 

max (/■<«) + «(")> ^ M/< n ) + * (n)) = /<"> + * (n ’ 
max (/ (n) + «("> ^/( n > + 


Q. 11. 
Ans. 


So by taking C, - — 
Prove 3n + 2 = 0(n )• 


= I and C = 1 the given statement holds 


lim 


3 ” + 2 lim f — + “T | = 0 


n _»ooi n n 


3. 


3n + 2 = O(n) holds. 

OBJECTIVE TYPE QUESTIONS 

The most popular asymptotic notations is 
(a) Big-oh (b) Theta 

(c) Liltle-oh (<*) ° me g a 

^O(n), where 0(n ) stands for order n is 

l$k<,n 

(a) O(n) (b) 0(n~) 

( c ) 0(n 3 ) (d) 0(3n 2 ) 

What is the running time to retrieve an element from an array of size n? 
(a) O(n-l) ( b ) O(n) 


( c ) 


°(tJ 


(d) 0(1) 


Retrieval from a linked list of size n has running lime 

( b ) 0(n ) 



(d) 0(1) 


^GROW TH OF FUNCTI ONS 

5. Which one of the foll„ win „ — 

hme complexities for the u WS the correct 
, x ~ /f ai gonthms *> 

(a) Oflog, n) < Oin) < G(n Jog 
«.) 0(n) < Oflogjn) < . 2 | 12 Lgfljjjj 


elationship 


uf (he 


0(n' 

Of 2" 


of n. Which 


one of the followi 


(c) 0(n) < 0(log 2 n) < 0(n log* 'I*™ 

(</) ^og 2n) <0(n ) <0(n log 2n)<r; '', 

6. Let f(n) = n 2 Ig „ and *(„) _ ‘ ’ < 0(2n) 

statements is correct •> 8 n> be two positive r 

r «UVC Functions 

la) m = °w n »™*g{n)*of {n)) 

(b) -nd/ 0 ,) #0(lrt 

(0 m*OU*)) and g(n)*0(f {n)) 

(d) f(n) = 0(g(n)) and g(„) = Oi/( n)) 

7. The running time of tht- r^n 

he fol,ow| ng algorithm 

Procedure A( n ) 

If n ^ 2 return l ; 

Else return A(ceil <^)) ; 

is best described by 
(a) 0(n) 

xx n/1 . W 0(log 2 n) 

(c) 0(log log, n) 2 

^ L * (<0 0(1) 

8. Consider the following three claims : 

0) (» + *)" = &(nm) where * and m are constants 

(D) 2" * = 0(2") 

(HI) 2 2 "*‘ = 0(2 n ) 

Which of these claims are correct ? 

^ (I)and(II) <*) (I) and (II) 

, W (II,andaiI > <« (I), <ff) and m 

9. The tightest ; lower bound on the number of comparisons, in the worst-case for , nm 

sorting is of the order of 1 ’ ,or com Panson-base 

(a) n (b) n 2 

(C) n 108 " (d) n log 2 n 

■ What does the following algorithm approximate ? Assume m > I and e > 0. 

x = m; 

y = l; 

while (x - y > e) 

{ x ■ (x + y) /2; 

y = m/x; 

} 

print (x) ; 
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( b ) m 
(d) m 


(<i) log 2 m 

, v \n ~_ 

(c) m 

nrnornm segment 
11. Consider ihe following P <- ‘ 

int j, n > 

j = 1 ; 

while (j <= n) 

The number of comparisons made in the execution of the loop tor an. 

ili (*) n 

(fl) (d) Llog 2 r.J + l 

(c) Llog, nj determine if an integer appears more than 

,2 The minimum number of comparisons required to determ.n 

times in a sorted array of n integers is 

( b ) 0(log n) 

(a) Q(n) 

^ ( d) None of these 




1 . (a) 
6 . ( a ) 
11. id) 


2. (b) 
7. (a) 
12. (a) 


3. M) 
8. {a) 


4. (6) 
9. (a) 


5. (d) 
10. (a) 


□cr 


■ 




/? ecurrences 


^.1. RECURRENCE RELATIONS 

An algorithm is recursive if it can call itself Recursive 
algorithms generally solve a problem by reducing the 
problem to an instance of the same problem with smaller 
input. Often times, a recursive solution to a problem is 
the most natural, and therefore gives the simplest 
procedure. We note the following two points. 

(o) Always identify the base case and associated result first. 

(b) Make sure the recursive call is for a smaller problem. 

When an algorithm contains a recursive call to itself, its running time can often be described by 
a recurrence. A recurrence relation is an equation or inequality that describes a function in terms of 
its value on smaller inputs. Let us consider the classical example of computing the factorial of a 

number. 


3.1. Recurrence Relations 

3.2. Substitution Method 

3.3. Iterative Method 

3.4. Recurrence Tree Method 

3.5. Master Method 


Example 3.1. The factorial function is given as, f(n) : 

n \ = n x (n - 1) x (n - 2) x .... x 2 x 1, where n is an integer 
Let T(n) be the running time for the following algorithm 

Algorithm 3.1. Factorial (n) 

1. If n = 0, then 

2. Return 1 

3. else 

4 . Return n * factorial (n - 1) 

5. End if 

Running time for lines 1 and 2 is 0( I), and for line 4 is 0(1) + T{n - 1). The factorials) is 
called (n - I ) times. 

Thus, for some constants 4 c ’ and % d\ 


59 




| d ifn = l 

\c + Tin - 1), if n> 1 

We substitute in the above recurrence, n = 1,2 

7(1) = cl 

T(2) = c + 7( 1 ) = c + ^ 
7(3) = c + 7(2) = 2 c + d 


Tin - 1) = c + 7((w 
7(/i) = c + 7(/i - 


- 1) 
1) 


Tin 


I ) = c + 

+ |c + Tin 


+ Tin 


and so on. In general, 
Finally, when / = n 


l)c + 7(w 


(w 




r( w ) = ic + Tin - i ) >1 w 

1 , we get 

7X«) = *e + T(n " = 

= c(n - 1 ) + T( 1 ) 

T(n) = c(n - 1) + d 

from the above, we can conclude T(n) is O(n). 

3 . 1 . 1 . Techniques Used In Recurrence Relation 

To sol., any gl.en Kourrcnc. mlndon. Wc can ns. .I.her of thn following four ,.chn„n« 

(a) Substitution Method 

(b) Iterative Method 

(c) Recurrence Tree Method 
id) Master Method 


^.2. SUBSTITUTION METHOD 


It is also known as bounding recurrence relation. When analyzing a recurrence relation that 
depicts the resources used by an algorithm, we are interested in rinding the tightest possible asymptotic 
bound on closed form. Thus, instead of determing the exact closed form, and then expressing this 
solution using asymptotic notation, it is often easier to make a guess directed at the asymptotic 
form, and then verify this guess using induction called constructive induction, the steps lollowed 

are : 

ia) Guess a particular solution in asymptotic form for the given recurrence relation. 

(b) Verify the guessed solution using mathematical induction and find the value of constant ( 

Example 3.2. Consider the recurrence relation. 

1 if /i = 1 


T(n) [7(#i - 1) + n, if w>l 

Solution. If we wish to prove that Tin) = Oin 2 ), then it is sufficient to show' that Tin) < Cn t 
some positive constant C > 0 and for all values of n > n 0 (n 0 is a positive constant). First, we w 

assume 


Then we will use ihis indue!, hyLl" ' “ “ 5 " ‘ 1 
hypothesis into equation (1 ) wc get ' MS *° sh,)W lhal Tin) S Cn 

T <n) = 7tn- | ) + n 
S C(n - |, J + „ 

= Cin 2 -2n + |) + n 

= Cn 2 -2 Cn + c + n 

2 T (n) ^ Cn 2 

T(n) <! Cn' holds for all „ > | whcn c . 

,ha. HI) = I. and from ,he induction hypo.'hesi Trnf^’ ~ 
base case, and hence Tin) = Oin 2 ). 1) - C( 1 ) Choosi 

3.2.1. How to Make a Good Guess 

For the given recurrence relation i.e., * 

T(n) = aT^y 

Case 


fin) 


By substituting the induction 


if T[n) ^ Cn 
then T{n - I ) s C(n - I ) 2 


we have 
tisfy this 


If a = h = 2, then 

7(n) = Oif in) log n) is a good guess. 

Case II : If a = 1, b = any value, then 

Tin) = 0(log n) is a good guess. 

Case III : if a * 1, b > a. then 

Tin) = 0[fin). n\ is a good guess. 

3.2.2. Bad Guess 

1. Let us gness Oin) for the recurrence 

T(n) = 2T(U/2j) + I 
thus we need to prove T{n) < Cn. 

Substituting this we get 

T(n) < 2C[[U/2j| + I 

< ^ + 1 
" 2 

= Cn + 1 

for any value of C, T(n) is not less than Cn. because of 1. Hence it is 
2. We make a larger guess T(n) = Oin 2 ), thus. 

T(n) < 2C^ + I 


a bad guess. 


= Cn 2 + 1 
= Cn 2 

if C > |, for large value of n this relation 
*gnore this value. Tin) = Oin 2 ) will hold. 


will hold as n grows much father than 1. Some 


can 


— 
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make an intermediate guess such that Oin) should hold. Let Tin) <> Cn - b. 


Tin) £ 2(y-/>)+l 

=2 Cn - 2b + 1 £ Cn - b, 
for b > 1 (if = 1, b cancels out with I ). Since b is constant this of order Oin). 

4. Let us guess Oin) in the recurrence 

Tin) = 2Tiln/2]) + n 

Thus we need to prove Tin) < Cn , substituting 

T(n) < 2C (§J + " = 0, + ” 

Tin) ± Cn as addition term is a variable, hence Tin) * Oin) in this recurrence. 

5. We have Tin) = 2T(L Jn J) + lg n 
here we can choose another variable, say 

, 1/2 s^m/2 

m = \g n => n = 2 , n —2 
Thus, r(2 m ) = 2 T a’"' 2 ) + m 

We rename T(2 m ) = Sim), 

s(y) = T( 2 ml2 ) 

Hence new recurrence is 

S(m) = 2s(|) + m 

As 2 m is written as m in new notation 5, hence we can write j(2 ml 2 ) as j but 

recurrence no solution. 

Oim lg m). Substituting form we get 0(\g n lg lg n). 

3.2.3. Examples 


Example 3.3. Solve the recurrence 

T(n) = 27^ j j + n using substitution method. 

Solution. Let us guess a solution 

T(n) = 0(n log n) 

i e > T\n) < Cn log n V n > n 0 

Substitute it in the equation i.e., we get 


T(n) < 1C 


log 


+ n 


< Cn log | + n 




(ZI= 

Aa n *re the n 

fl 

Hence j y 

Now, 


NOT! 


Tin) <, Cn log 

By induction hypothesis we require to 

condition, i.e., 

T{\) < C(\) (log I 
Thus for any value of C, this will not hol< 
Tin) <1 Cn log n 

Ti 3) < 03) (log ! 
as V can’t be I, this relation holds for C 
Thus. Art) = Gin log n) 


Example 3.4. Show that solution Tin) = (Ln/2 .]) ♦ 
Solution. Let us guess that solution is 0(lg n), thu 

Substituting this we get. 


Tin) < C log ^ + I 

= C Ig n - C Ig 2 
= C Ig n - C + 1 
< C Ig n for C > I 
Hence, T(n) = 0(lg n) for C > 


Example 3.5. Solve Tin) = 2 T(Jn) + 1. 
Solution. Let m = lg '*• s l '* 

Thus. 7'(2 m ) = 2Til mfl )+ 1 

Changing the recurrence to S{m) = T(2 ). 


We get, 


Sim) 



Solution to this 0(lg m). 

Therefore Tin) = 0 (Ig Ig «)• 

Example J.6. Show (hai solution to Tin) = 2Ti n/ 

Solution. Lei us guess solution is OOi Ig «> then »e 

get. 
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Tin) 


= Cn Ig n - Cn Ig 
s Cn Ig n - ( n + 
= Cn Ig n - (C- 
= Cn Ig n - bn + 

,1 c > I. where h is constant. 

Hccc. TO, ) = 0(n Ig ") 


Example 3.7. Show lhal solution 
solution is 0 <n Ig «)• 

Solution. Let the solution to Tin) is 


of TOO = 2T)ln/2 


n is Odf Ig n). Conclude that th 


Q(// lg n) then we need to prove 


ove Tin) 


I 


T(n) > 2 ( c f'ef) + " 

> Cn lgy + n 

= Cn lg n - Cn Ig 2 + n 
= Cn lg n - Cn + n 

> Cn Ig n for C > l 

Therefore T(n) = CIO, Ig n), for C < 1 but for large values of n. and CTO,) < Cn Ig n also hoi 

hence Tin) = 0(n lg n). 


Example 3.8. Show that solution to T(n) = 2T\ \ ^J + 27 ) + n IS lo 8 ;,) - 

Solution. Let us guess solution is 0(n Ig n), then we have to prove Tin) < Cn lg n % substituting \ 


get. 


2 (lf J +27 ] lg (lf-l +27 ) + " n 


As n is the number of element and which is very large hence, 

H&v f - LfJ-rfi 

and adding a constant value to this large value ^ does not effect its actual value, hence 

UJ ■ ? 


we get 


TOD < 2C^lg%„ 



...U) 


= Cn log n - Cn lg 2 + n 
= Cn lg n — Cn -f n 
T{n) < Cn lg n, V C<>1 
Hence T(n) = 0(n lg n) is true. 

||.3. ITERATIVE METHOD 

This technique is also known as backward substitution. In this method, we simply continue to 
substitute back until we see a pattern of some sort. We then deduce a formula from the pattern. 
Once we discover a likely formula we prove that the formula actually solves the re< :urrence relation. 

Example 3.8. Solve the following recurrence 

(1 if n = 1 

T{n) = \ / n \ 

I 27| — J + n if n > 1 

Solution. Since we have 

SB T{n) = 2 ( 2r fe) + f) + " =4T (i) 

Substituting for we obtain 

r( , 0 =4 (2r(f) + f) + 2„ = 8 r(|) + 3 n 

Continuing in this manner, we find that 

9K' T(n) = 2 K T[±yKn 

After log 2 n substiiution (K = log, n), we have 

T(n) = 2'°^’' xri-^} + \o^nx,,. 


In 



Noting that 2 I ° 8: '' = n , we have 

T(n) = /t x 7 ^ j + « x log, n 

T(n) = nT{\) + n log 2 /i 
T(n) = n + n log, n as 7'(1)= I 

Example 3.9. Solve the following recurrence using iteration. 
Tin) = 3 T ['i) + " 



r® 

Substitute r(j) in equation (I) 


Tin ) = 3 


37 f j j 

l 16/ 


/» * 9T i 


16 ; 



Continuing in ibis manner we get 

3 n^n + 3 ' 7 

Tin) = ' ,+ 7 + T6 U' 


Assume * I since H I ) = • 

4' 

/ = log. n 

i.e. 

Substitute i = log 4 n, wc have 

-j n q n 

T(n) = '> + 3 4 +9 ,6 


I 


+ 3 e / i 1 


- £ -i- x n + 0 (n ,og4 3 ) 

< S" x (l) +0( " log ‘ :,) 

(=0 v ' 

ux 

\AJ 


T{n) < "X 3 
4 


+ 0(n ,og43 ) 


< 4/7 + 0(rt ° 84 ) 

< 4n+0(n) as log 4 3 < 1 

T{n) = 0(/i) as 1 0{n) + 0(/t) = Oin)] 

. 4 . RECURRENCE TREE METHOD 


We can visualise iteration method as recursion tree in which at each level nodes are expa 
We consider second term in recurrence as root. It is useful when divide and conquer algorithm is 





Fig. 3.1 


Hence solution is 0(n~). 

Summing the values at each level, we get 


2 , n‘ n 
n 2 4 


= n 2 ( ,+ H + ■•••) 


Ign 


32 ' 32 ' 


Hence, solution is 0(/T). 

Useful Formulae : 


= In 


(1) — if common 

i=i a ' 


ratio is less than I, then convert it in infinite GP series i.e. £ , 


(2) Xt . for infinite GP series, the formula is , 

1=0 a 

where a = f irst term 

r - common difference 



i 



I^ cuhrbnc es_ 


T(2n/ 


III. 



Fig. 3.4. 


Example 3.12. Solve the following recurrence 

T(n) = r(o/i)+nn-a)n| + n. lotlS 1 

Solution. I. 



T(an) 


T[(1 - a)n] 


II. 


(1 - a)n 




7 (an) Tl(1-a)an] Tl(1-a)an] Tl(1-a)n] 
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Height of the tree is 

0 (log|/ a n) ifa>l 

0(log, / ,_ o '») if a < 1 

J\n) = » + n + .... + (log, /n n + Dlimc 

HR - k |" 

i | B ML ■/ : s 0 (n log, /(l w). 

||.5. MASTER METHOD 

The master method provides a “Cook book” method for solving recurrences of the form : 
7Tn) = «r(f) + /W 

where a > 1 and b > 1 are constants and f(n) is an asymptotically positive function. The mastt 
method requires memorization of three cases, but then the solution of many recurrences can bt 

determined quite easily. 

The above recurrence describes the running time of an algorithm that divides a problem of size 
n into 4 a subproblems each of size ~ , where a and b are positive constants. The 4 a ' subproblem* 

are solved recursively, each in time rf^j. The cost of dividing the problem and combining tht 
results of the subproblems is described by the function /(/i). 

As a matter of technical correctness, the recurrence is not actually well defined because ' 

might not be an integer. Replacing each of the a terms T 
not effect the aymptotic behaviour of the recurrence. 


(i 


with either T\ 


liJ) 


or 71 


co 




Tin) = aT [l) + f(n) 


n, erc we interpret ^ to mean either ! ” I 0 r f”l 
Then 1\n) can be bounded asymptotically as follows : 

1. If (r*) = 0(n l08 ' , ‘ , ' € ) for some constant 6 > 0, 

then r <") = 0(n lo “ a ) 

2. If fin) = 0(n' ou ‘‘) ‘hen 

Tin) = (-) (,i I o8 ‘“ |og 2 ;i) 

3. If /(n) = I2(n log *‘ ,+e ) . for some constant e > 0. Then and if a/I ^J<Cx/(n) for some 

constant C < 1, and all sufficiently large n, then 
T(n) = 0 (/(«))■ 

Before applying the master theorem, let us spend some moment trying to understant what it 
says In each of three cases, we are comparing the function fin) with the function with the function 

^ If as in case 1, the function h 108 *" is the larger, then the solution is Tin) = 0 ° ) • If as in 

case 3, the function fin ) is the larger, then solution is T(n) = 0(/(n)). 


Example 3.13. Solve the recurrence using master method. Tin) - ?T { 3 J + " 
Solution. Here, a = 9, b = 3, fin) - n , 

n log = „log 3 9 =n log 3 (3) 2 = „21ogj3 = „2 

Writing /(/t) in appropriate form 

/(„) = Oin"*' 9 -') = OW 

hence we can apply case (0 

So the solution is 0(n l ° Sl ’ ) by case Le " 

0 (n ,og J 9 ) = G(n 2 ) 


Example 3.14. Solve the recurrence by master method. 

TO) = ?( y) +1 - 




which is equal to /(n), hence case ( iii ) applies. 

Thus solution is 

T („) = e(n^‘ , .lg«) = 0<"g'') 

= 0<lg n). 

Example 3.15. Solve the recurrence by master method. 

Tin) = 3 r(5) + *l«" 

h = 4 f(n) = n l g« 

Solution. Here. a - s, b 

_ n' 0 * 43 =0(n 0 793 ) 

/(n) = flirt 11 ” 843 *' 1 ) where e = 0.2, case 3 applies. 

Here we can see that regularity condition of case 3 holds. 

<>. * CfM 

*(4) 108 (4) s(|)' ,1 8 n = C/(,,)f0rC= 4 | 

Therefore solution to the recurrence is 

T(n) = Q(n\gn) = Q(f(n)) 

Example 3.16. T(n) = 2 r^j + nlgn. 

Solution. cl = 2, b = 2 t f(n) = n \g n 

We have, n ,og * fl =n ,og22 =/i 

Thus/(n) = n lg n is asymptotically larger than n log * a , i.e. n but it is not polynomially greata 
as the ratio of ■ = lg n is asymptiotically less than n for any +ve value of e. Hence, Mastc 

n '°&b a 

theorem can not be applied. 

Example 3.17. Solve T(n) = 27 , ^j + /i 3 by master method. 

Solution. We have a = 2, b = 2,/(/z) = n 3 
n* ogb 0 = n log2 2 = „ 

Case (i/i). /(/i) = Q(n ,0 ^ fl + e ) = Q(n 1 + 2 ) , here e = 2 





| pc cURfl ENCES _ 

and •>*>• 2 /(fr) <f/( ' ,3) - is ,ruc C 
Tin) = 0(n 5 ) 


Example 3.18. Solve Tin) = r(?2) + n by maMer 


t , 10 r/ v 

Solution. Here, a = 1, ^ = ~,/(n) = n 

n ,ogfc a = n 108,0/91 = n° = J 

We can write fin) = n = 8(n) = 0(n logfcfl + c j 

- 0(n° * ’), where e = 1 

So case (iii) applies 
Also. a/[^|<Cn. as 

- /(f) -|S S c„.,„c.± 

Hence regularity condition is also satisified, therefore, 
T(n) = 0(/(n)) = 0(n) 


Example 3.19. Solve, T(n) = l6r ( 4 J+" 
Solution. By master theorem. 


a = 16, b = 4,/(n) = n 
n i°n* _ „'°8< 16 = „ 2 =0(n 2 ) 

/(„) = „ 3 =(n ,< **“ te ) = (« 2+, )=0(» 3 ) ande=l 


Also, 


16/ 




C/(n 3 ) 


< cn 3 for C = - , it is true so regularity condition holds. 
”'64 ’ 4 


Hence, by case (iii) T(n) - 9(/(n)) ®( n " * 


Example 3.20. Solve T(n) = 3^(f) + " ,ogn 
Solution. By master method, 


= 3,b = 2,f(n) = n\ogn 


ALGORITHM ANALYSIS AND Dgi 


^1 


= 0 in 


f («) 


vhere 


: 0.58 


Wc are not sure whether we can the apply the master method 

i .58 an d also it is in proper form t.e. a = 3 t 
As we have /(«) = " "• and " = ” ’ 

fin) = n Ig n, 

But/(n) is asymptotically smaller than, 

log** _ J» /* Oin**) > 0(n log n). 

n = ft , i.c ^ < 


hut is not polynomically smaller than n 


asymptotically greater than n for some +ve 
(i) and (//). 

Hence. 


i.e., n log n > n' 5% The ratio 

constant e. So the recurrence fails in the gap of, 


Tin) = 0(n' 58 ) 


Example 3.21. Solve the following recurrence using master method. 

(«) TOO = \t[\ ) + /<«> 

(b) T(n) = 2Tin) + n 

(c) T(n) = 2 

™ = 4T (zi} 


id) 

Solution. 


log 2 " 


ia) a = - , b = 2, fin) = f(n) 

as a < 1 but according to master theorem 
a > 1, hence master theorem is not applicable. 

ib) a = 2, b = 1 , f(n) = n 

as b = I, but according to master theorem b > 1, hence 
(c) a = 2, b = 4, fin) = -n 2 


master theorem is not applicable. 


F„ iS 3 _Ve fUnC u° n ' bUt aCC ° rding t0 ,he master theorem /(«) should be bounded as i 

function, hence master theorem is not applicable. 


(d) a = 4, b = 64, f(n) = H 5 — 
J 7 log 2 n 


According to master theorem, the function f( n \ in i . . wJ 

re K > 0 but here f(n) - n Ino" 1 u / > he relation should be of the form n*lc 

_ ere/( ” } ~ " 108 " hence theorem is not applicable. 



(sowed examples 


Example 3-22- Solve the recurrence, Tin) = 7r^] + (I >. 

Solution. By Master theorem, 

a = h ~ 2. f(n) = n 2 

n'°““ = " ta * l7 =e(n J8 ) 

/(n) = 0(n lo, ‘“" , ) = O(n 2,1 ' 0,t - ) = o (n 2 ) 

There by case 1 , we have 

T(n) = 0(n^» a ) = CKn 1 *') 




Example 3.23. Solve the recurrence, T(n) = 77 ( ? ] + n 2 . 

Solution. Applying Master theorem 

a = 7, b = 3, /(n) = n 2 

= n k> *> 7 =0(/i 177 ) 

/(n) = £2(n lo8,, ‘’ + £ ) to match with n 2 
G(n 1 ' 77 ' 1 ' 023 ), e =0.23 

So case 3 can be applied, check for regularity condition, 

of(i) < cm 


7/ 


(*)< 


< Cf ( n 2 ), is true for C = ^ 


hence case 3 holds 

Thus, T(n) = S{f(n)) = 0(n ). 


Example 3.24. Solve the rec,7rrence byltera.ion and draw its recursion tress if possible. 


Solution. 


We have 


- T( n - 1) + n, by iteration method. 

= n + T(n - \) 

= n + (n - 1 + T(n - 2)) 

= „ + („ _ 1 + (n - 2 + T(n - 3))) 

= „ + 1 +n -2 + n- 3 + ...• + W 

r(l)=0(1) ■ , n *2 + 3 + ... n) + 6(1) 

= (n + n + n + •••• « times) - (1 

= „2_„ + 0(l) 




n-2 


n-2 


Total : fX" ) 


Example 3.25. T(n) - Tin D + „ • 
Solution. By iteration method 


Tin) = - + T{n-\) 

_ I+f-L- + r(/.- 2 ) 

“ n ^ n - I 

= i + - L T + f-TT + r(n_3) 

“ n n - 1 n -2 n -3 

V — !— + r(i)sY — U + 00) 
= h --o' 1 -' 


Let n - / = x. -Ji = dU\ di = -dx 

Thus, it can be transformed into an integeral 


y 1 _ r° dx 

A n - / J" x 


= //u 


Thus, 


T(n) = 0 (/n n) + 0 ( 1 ) = 0 (lgn) 


Example 3.26. Tin) = 2t| ^j + » solve this recurrence. 


Solution. 


T(n) = 2 F £ 


f £ l + — 

UJ Ign 


2^(f)-”lgn = 2r^]-e(n lgn) 


Tliis can t be solved by master method, solving the iteration method we have the sumnvH 

(k-\ \ 


IT 


(!) - 

\i*0 


2*“' I rko > 


log (2 1 ) 



I RECURRENCE!. 


X(*-0 


- 2 k(k + l) = 0(n log 2 n) 

As * = log n 

a nd this term is greater than 0(n lg n ) therefore solution to recurrence is Tin) = 0(n log 2 n). 


triple 3.27. Solve the recurrence T(l) = 1, T(n) = 3r(^ j+ 2n 15 . 

Solution. We have. T(n) = 3 r (f) + 2n ' 5 

For converting it to proper form divide both sides by 2. 

Tjn) 3 T ( n ^ m i .5 
2 

T{n) 

9 


= ^ r f + 5 
2 \ 2 ) 


Let 


= U(n) 

,(l] 1 


f ,( n ] 1 T [ n \ 

=* Hi) = i r li) 

Substituting in (li) we get. 

t/(n) = 3t/(f) + n 15 

and also. W> = I° S 

Now. we can solve the recurrence equation (Hi) by master method here. 


By case 1 , 

Hence, 

Since, 


a = 3, b = 2, /(n) = * 

„!<*»<> _ n l0 8i 3 = n 1 585 = n 1 59 

/(„) = 0 ( n ' O8 “ , ' e ) = 0("' 59 ' 009 ) 

= 0(n' 59 ) 

(/<„) = O(n 159 ) = 0( n ,o8j3 ) 

T(n) = 2 .(/(«) 

T(n) = OC" 1082 ’)- 


T ,„, - 4T f "1 + " 3 - 

Example 3.28. Solve the following recurrence. T( UJ 

Solution. By Master method, _ n 3 

A = 4, 0 = A / 

_ n 2 =0(n 2 ) 

„ , 

By case 3, 


...(0 




...(iii) 


where, e = 0.09 



4 


ALGORITHM ANALYSIS AND Ogs 


1S , case 3 can be applied, now check for the regularity cond.t.on 4 / 

:nce is B (fin)) 

T(n) = BCn*). 

T(n) = * T [l) + " 2 - 


Thu: 


true for C = j hence solution to this recurrence 




I 


Example 3.29. Solve the recurrence, 

Solution. By master method, 4 f _ 2 f {n ) = n 2 

n iog b a _ n iog 2 4 =n 2 = o (n 2 ) 

Hence, case 2 can be applied. 

/(„) = 0(n IO8 ‘‘') = e(n 2 ) 

Thus solution to recurrence is, 

T(n) = 0(n log,,u Ign) = B(n‘ lg«)- 1 

; ; _ Tin _ + T(a) + n , where a £ 1 is a constant 

Example 3.30. Use iteration to solve T(n) - T(n a) + 

Solution. T(n) = T(n-a) + T(a) + n 

- (T(n-2a) + T(a) + n-a) + T(a) + n 

= (T(n - 3a) + T(a) + n - 2a) + 2T(a) + In -3 


n/a — 

= £ na)+ 'Z'l-ia 
=0 1=0 

n/a n/a 


n/a 


/ \ n/a n/a 

= ( £ r(o) + l>-aX < 

W ;to ,=o 

( \ n/a n/a 

''"S' 


Example 3.31. Characteristic each of the following recurrence equations using the master 
method (assuming that T(n) = c for n < d y for constants c > 0 and d £ 1). 


(fl) 

T(n) = 2T(n/2) + log /i 

(*) 

7-(/») = 8T(nl2) + n 2 

(C) 

r(n) = 167(n/2) + (n log n)‘ 

(4) 

r(n) = 7T(n/3) + n 

(<) 

T(n) = 9T(n/3) + n 3 log « 


Solution. (a) T(n) is O(n) (case 1). 

(b) T(n ) is 0(V) (case 1). 

(c) T(n) is 0(n log 5 n) (case 2). 



^E CU»" ENC J1 


(<f) T(n) is 0(/i'”*’ 7 ) (case 1 ). 

(e) T(n) is 0(n 3 log n) (case 3). 

exercises 

l ' Solve the recurrence exactly for n a power of 2. 

f 1 if n = 1 

Tin) = \ ( n \ 

J + (nlgn) 2 if otherwise 

2. Solve the following recurrence exactly for n a power of 2. 

f 1 


Tin) = 


3. Solve the following recurrence exactly 


if n = 1 
if n = 2 


™ 


^ - “ t [ — I otherwise 

2 \2 J 2 V4 J 

n 

T 2 (n - 1) + i T 2 (n - 2) + n otherwis 


if n = 0 or n = 1 


4. Solve the following recurrence for n of the form 2 

1 


Tin) = 


if n = 2 

2T(Jn) + \gn otherwise 
5. Solve the follow.ng recurrence enitly as a function of initial conditions u and b. 

a if « = 0 


T(b) 


- \b 


if n = 1 

1 + T(n - 1) / T(n - 2 ) otherwise 


(a) 

m = 

Kt)*" 

(b) 

T{n) = 

KtH 

( c ) 

T(n) = 

•Kf)**’ 

id) 

7 \n) = 

8r(j j + « 



f n) 2 

ie) 

Tin) = 

4r U) +n 





9. Solve the following recurrence T{\) = 0 

Un) = 7(U/2j) + 7TL/I/2J) + n - I . 
10. Find the closed form expression and their asymptotic notations 


(a) 2 ' 

i=0 


w 2 


w 2 2 ' 2 


LV'^J 


( QUESTIONS WITH ANSWERS 1 


Q. 1. Solve the 

Ans. 


recurrence T(n) - + . by iteration method. 

n») = r^j + n * 


= 7tM?) 
-***(!)‘ + (S)* 


ft 

When 7 = 1 n - V -a ,• , 

3' i =? n - j => / = Jog 3 n. 

Now for upper bound, 








7'(n) < n k 





. + n 


A 




T(1) 


Fig. 33. 

The sub-problem size for a node at depth " s 4 


When “7 = 1 => « = l °g4 n 

Now we determine the cost at each ^ dcplh , 

the level above, and so .he number of nodes P 

; = 0, 1,2 log, n - I. has cos. of ' 


1 than 
i, for 




4' ) 


Now, wc add up the costs 
7T n) 


. 


+ 0(/T 


16 


I 


i=0 


■ tfe) 


+ 0 (* 


p 


,16/ 

! cn 2 +0(n l0843 ) 

' "(4) 

16 2 .c|/ M log4 3s 

= — cn +0(/i / 

13 

= 0(n 2 )- 

Q. 3. Use recurrence tree to give an asymptotically tight solution. 

Tin) = T(n-a) + T(a) + cn where a > l,c>0. 

, Cn ► Cn 

Ans. 


C(n - a) 


C(n - a) 


C(n - 3a) 


Ca 


Ca Ca 


Ca 


Ca 

I 


Ca 


Cn 


► Cn 


Cn 


Series termiantes when n-ka=\=>ka = n- \ 


Total : O (n ) 


* = ^ = ^ levels 
a a 


Total cost, T(n) = ^j.c„ =0(n 2 ) 

Q. 4. Use master method to give tieht asumn, .• u 

8 8h ‘ dSymptot,c bounds for the following 


(a) 


T\n) =4 r 


(!)♦■ 


recurrence. 


:es 


<M 

T\n) 


(0 

7 Xn) 

■ 47 (f)‘" ! 

Ans. 

T[n) 

• "(!)*" 


a 

= 4. fe = 2, f{n) = n 

Now, 

n 'og h a 

= „‘» 82 4 


n lo8 * ° 

> /(n) i.e. n 2 > n 

We apply Case l. 

T(n) 

= S(n 2 ) 

( b ) 

7 l(n) 

= 4r (f) + « J 


a 

^s: 

II 

1c 

< 

fs|' 

II 

-C 

rt 

II 

Now, 

n 1og fc . 

— log} 4 2 

= n = n 



= f(n) i.e. n 2 = n 2 


We apply Case II, 


( c ) 


Now, 


7 \n) = 0(n 2 logn). 

TV.) = 4r (f) + n3 

a=4, b = 2, /(n) = n 3 

log** _ J°S2 4 = M 2 


n 108 * 0 < y( n ) i € ' n 2 < n 3 


Now we apply Case HI, 

af[^] < c.fln) 

\b ) 


4— < cn J 
8 


c * 2 


Solution is f(n) = 0(n 3 ). 


Q. 5. Can the master method be applied to 

+ log n 


_ 47 'f l) + n 2 log n ? Why or why 
the recurrence T(n) - 2 J 


not. 


A ns. 


TV") = 4T ' 


It has the proper form 


’ fl = 4, b = 2. /("> = " 2 108 " 






Q. 7. Solve the recurrence T(n) = 3r [ jJ + n log 
^ a = 3, b = 4, /(n) = n Ig n 


„ lo «* o 


„log 4 3 ss/| 0.90 


' ‘ 0 2 c “ ~ *- «... * re£ .,„, 


(f) S C./(«) 

3(4 ) (4) 5 c«Iog/i, 


Hence, r(/i) = Q(nlogn). 


c-l 

4 


«. ». 7k JT«) 77 ( 2 ) + «’ describes Hie rum, mg rime of a | 8orithm . A 

^or/ta «■„„ . running ,ime TV) . «r(j) + .7 . Wb., i, largt s, in« e „ ^ a, ... 
such that /T is asymtotically faster than 4 ? 


Ans. For A : 



Using Master method, 


a = 7, h = 2, /(n) = n 2 



Is 

Sap 


Now. 

We apply Case-I 


r<„) = u7 ”(^) + n 2 

“ = a. h = 4. /(„) = , 


- n 

bui f(n) is same in both algorithms, which lead u 


to try the first 


l°g 4 a < log >7 


o < 49 which happens when a = 48. 

A' is asymptotically faster than A as lone as « <r , 

a = 4g ng as a K Hencc * is asymptotically faster than A upto 


Q. 9. Solve T(n) 

A ns. 

Here, 




nn) = 2r (.)*' / " 

a = 2. b = 4./(n) = „>'* 


log* a — 


= iog 4 2 Io8 i 2> 2 2 ~r 

— n ' =n 2 




Case U apply 
Hence, 


71(n) = ©(Vnlogn). 

Q. 10. Solve 7\n) = 27’fl yj J + n. 

Ans. Because we know that the floor and cell functions are usually insubstantial in solving the 
recurrences, we convert the given equation, into 

T(n) 


= 2r(j} + n 

(?) ■ 2r (f) - d 

71.) - rr l^)‘" 



T\n) = 0 (n). Ans. 


Q. 11. Show that the solution of the recurrence T(n) = * s 0 (h). 


Ans. Because we know that the floor and cell functions are usually insubstantial while solving 
recurrence relations. So omitting floor function we get 


7 \n) 


= 37^j + n 

- 3 HtsB] + " 

-BiiB"*" 

- 3 , HsBB— 


-^Mr-er- er- 

Suppose after i iterations we approached to the initial condition 


< 1 => 4‘ < n => i < log 4 n 


Substituting the value of i in the above equation we get 

TXn) = O(n) 



* = —n log n n 

Here fin) is larger ihan bu , 

larger only. So that is why we can', p0,yno^n,a, ,a gcr. while 

" 1 a PP'y theorem in 0,i» rec 


loganthmicalh 


"• “"t’”’ <■< ;*• tomt , „ „ 

int recursive (i n t n) 

{ if (n — i) return ( 1 ) ; 

aloe return (recursive (n - D + 
y in ♦ recursive (n - 1)); 

(a) O(n) 


(c) 0(n 2 ) 


for n = 1 
for n < 2 


(b) 0(n log n ) 

( d) 0( 2 ") 

l. The following recurrence equation evaluates to 

no = i 

T(n) = 2 T(n- l) + n 
(a) 2n + I - a - 2 (b) 2n - „ 

(c) 2n + I - 2n - 2 (rf) 2n + n 

3. Suppose T(n) = 2T(„/2) + n. T(0) = T( I ) = I . Which one of the following is false 

(a) 1\n) = 0(n 2 ) (f>) T(n) = Q(n log n) 

(c) 1\n) = £2(n 2 ) (</) 7(n) = 0(n log n) 

4. What is the time complexity of the following recursive algorithm ? 


int doSomething ( int n) 

{ if (n <= 2) 

return 1; 

else 

return ( doSomething ( f loor(sqr(n) ) ) ♦ n) ; 

) 

(a) Q(n 2 ) ( b ) (?(n log 2 n) 

(c) 0(log 2 n) (d) @(log 2 log 2 n) 



-G 


1 . (d) 


2. (a) 


3. (b) 


4. (d) 


□ □□ 






Divide and Conquer 


In computer science, divide and conquer is an 
imporant algorithm design paradigm. It works by 
recursively breaking down a problem into two or more 
sub-problems of the same type, until these becomes simple 
enough to be solved directly. The solutions to the sub- 
problems are then combined to give a solution to the 
original problem. A divide and conquer algorithm is 
closely tied to a type of recurrence relation between 
functions of the data in questions; data is “divided” into 
smaller portions and the result calculated thence. The 
divide-and-conquer algorithms consists of three steps : 


■/inside this chapter^ 


4.1. Multiplication of Two n-b.t 
Numbers 

4.2. Binary Search 

4.3. Merge Sort 
j 4.4. Quick Sort 

4.5. Maximum and Minimum 

4.6. Subset Sum Problem 

i| 4.7. Strassen’s Matrix Multiplication 


1 . Breaking the problem into several sub-problems that are similar to the original pi 


smaller in size. 

2. Solve the sub-problem recursively (successively and independently) and then 

3. Combine these solutions to subproblems to create a solution to the original problem 


The technique named “divided-and-conquer” because a problem is conquered by divided it mi<> 
several smaller problems. This technique yields elegant, simple and quite often very efficient 
algorithms. 

For example, if the work of splitting the problems and combining the partial solutions is 


proportional to the problems’s size n, there are a bounded number b of sub-problems of size ” at 

each stage, and the base cases requires 0(1) time, then the divide-and-conquer algorithm will have 
0(n log n) complexity. 


Divide and conquer algorithms typically have a time complexity recurrence relation of the 

form : 





« ,hl. d '« °« «K reUtion „ ,„„ ,,, , 5 *«. „„ 

If a > ft 1 , then Ttn) = oin 10 !,*! n ,s P°"'c r of fc : j e n _ , 

If a = b\ ihen T(/i) = 0(n‘ log n) 

If a < b. then T{n) = <?(„* j 

H.l. MULTIPLICATION OF TWn B , T 
p r ,v *0 n-BIT NUMBERS 

The traditional method of multipii catio . 

The divide-and-conqucr method provide* ° ‘7° "‘ blt numbers requires 0( 
and Kbe two n-bit numbers. Assume n is a power o'fTw^ COmplexit y 0(„"* 3 ,f o,,!* . 
vn below. Each half is of nl 2 bits *" e P ar ^^ ,on X and Y 


) b 't operations 


shown 


log 

each into two hal 


X 

Y 


We may write the product as : 


A 

B 

C 

D 


z - XY -(A2" n + b)(c2" 12 + d) 
= AC2" +(AD+flC)2"' 2 +flO 


This requires 4 multiplications of § bits number p.us some additions and shift, (m u„ iplicatic 
by power of 2). This way of d.viding the problem and carrying ou, 4 mult, plica, ions will lead 


0(n 2 ) complexity. Le, us try to find a faster way by reducing the number of multiplications of § 
bit number through rearrangement in the computation process. 

The product Z of X and Y can also be computed by the following program. 

Algorithm 4.1. Multiply [A, B, C, D) 

(1) U = (A + B) and (C + D)\ 

(2 ) V = A* C; 

(3) W = B * D, 

(4) Z = V * 2 n + [U - V - W\ * 2 ntl + W; 


We assume that A+B and C + D have only y bits, ignoring the fact that due to carry, A + B 


C + D may be 



bit numbers. The scheme requires only three multiplication of j bits. 


numbers, plus some additions and shifts, to multiply two n-bit numbers. One can use the multiplication 
routine recursively to evaluate the product U, V and W. The addition and shifts require time 0{n). 
Thus the time complexity of multiplying two r/-bit numbers is bounded from above by : 



= 3*n'° Sl3 -2kn (Since 3 1 " 82 " = n lo|! = 3 ) 


Therefore, T(n) = 0(n'°* 2 3 ) = 0(n' 59 ) 

Suppose X = 0101, Y = 01 10. Then A = 01, B = 01, C = 01, D = 01 

V - (A + B) (C + D) = 1 10, V = AC = 001, W = BD = 010 
W = V , *2 4 + (l/-l''-W / )*2 2 +W 
= 00010000 + 1100 + 010 = 00011110 

^.2. BINARY SEARCH 

A binary search algorithm is a technique for finding a particular value in a sorted list, it makes 
progressively better guesses, and closes in on the sought value by selecting the median element in a 
list, comparing its value to the target value (key), and determining if the selected 
•than, less than, or equal to the target value. A guess that turns out to he too s p" ti i "his 
top of the list, and a guess that is too low becomes the new bottom oM e 




approach iteratively, it narrows the sear h — 

the binary search consists of 'he follow!^. afactor of tW( , 

1. Search a sorted array by repeated* : 

2. Begin with an interval cover;* 'v d,Vldin 8 the search ; , 

3. If the value of the search kTy " Wh ‘ ,,C ^ *" ha,f 

interval to the lower half. Otherw” ' han ,hc '««■ in the m ih, 

4. Repeatedly check until t hc value iTf '' ' he u PF*'r half* ,Werval - narrow the 

The most straightforward i mn | em „„, ° Und ° r ,he interval ,. m „, 

array dictated by the comparison "° n is recursion, which 

t recursively searches the Sub- 

Algorithm 4.2. Binary Sa.rch (,„ „ , 

I. If (high < low) ' V * ,u,> lo », high) . 


H not found 


2. return - 1 

3. Endif 

4. mid = (low + high) / 2 

5. If (arrfmid] > value) 

6. return BinarySearchfarr, value, low mid n 

7. Else If (arrfmid] < value) 

8 E, s r BinarySCarch(arr ’ value - mid + 1. high) 

return mid // found 
Endif 
Endif 


9. 

10 . 

11 . 

12 . 


The algorithm is invoked with initial low and high values of i a „H ™ 7 ~- 

recursion above and convert this to an iterative implementation. Iterative oneTspr“dt 
Algonthml.ll. Figure 4.1 illustrates trace of the algorithm to find the target value of 65 


mid = (low + high) / 2 = (1 + 9)/2 = 5 
arr [mid] < value (55 < 65) 

low = mid + 1 = 5 + 1 = 6 
high = 9 

mid = (low + high) /2 = (6 + 9)/2 = 7 
arr [7 ] > value (75 > 65) 
high = mid -1 = 7-1 = 6 
mid = (low + high)/2 = (6 + 6)/2 = 6 
arr [6] > value (65 > 65) — > false 

arr[6] < value (65 < 65) — > false 

arr[6] * value (65 = 65) — > false 

Found at mid = 6 . 
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Fig. 4.1. Trace of binary search. 

Binary is a logarithmic algorithm and runs in 0(log 2 n) time. Specifically, 1 + log 2 n iteration 
are needed to return an answer. In most cases it is considerably faster than a linear search. It can be 
implemented using recursion or iteration, as shown above. 



log 2 n 


Fig. 4.2. Trace of binary search algorithm to find 65. 

Let us verify the height (or depth) of the binary search tree with log 2 n values. Notices the 
following table. Binary search tree of Fig. 4.2 has n = 9 nodes. Hence, its height is Llog 2 9j = 3. 
Note that this is an upper bound. 
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4.2.1. Analyela of Binary Sear^ 

The time complexity for the binan- u 

y search may be written as : 

>»Y \ H **1 

/(//) = 1 / N 

( V 2 J + *• " > I ’ Where k is any conslan t 


1128 

I 6 »0 T 6,02 7 .0n~ 

mttt 


T{„) = Tf|j + * 


ation 

mbc 




+ 3 k 


Tin) = T {±y r k 

= T(l) + rl, where 2' = r is a positive integer 
= (r+ I) * 


= 0 + log 2 n) k = 0(log n) 

P.3. MERGE SORT 


Merge sort is an Oin log n) comparison- 
based sorting algorithm. In most implementa- 
tions it is stable, meaning that it preserves the 
input order of equal elements in the sorted 
output. It is an example of the divide and con- 
quer algorithmic paradigm. 

Sorting by merging is a recursive, divide- 
and-conquer strategy. In the base case, we have 
a sequence with exactly one element in it. Since 
such a sequence is already sorted, there is 
nothing to be done. To sort a sequence of 
elements (n > 1) : 


Divide array into 
two halves 


Recursively sort 


(0 Divide the sequence into two sequences 
of length f nt 2~\ and \_nll\ 



i 


Sorted arrav 


Fig. 4.3. 








(i/) Recursively sort each of the two subsequences; and then 
(Hi) Merge the sorted subsequences to obtain the final result. 
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Fig. 4.4. Two-way merge sort 


























| divide and conquer 

Figure 4.3 shows the idea of _ 

sort algorithm. We assume t 0 sort , h „ '° n Fi 8 4.4 i|| Us , r!> , 

«*— !» : •111.... «|f./2 l| 

resulting sorted subarrays are merged L ' a( "l Each J 
array of nine elements : (75_ 4 () j ( ' Produce a sing| c S(> 
array into subarrays and merges n„. ' °’ 50 - 95 • 55, is 
the Fig. 4.4 (Dashed-line arrows ind* ** S °" ed -barray, b, 
process). irie prenress of splitii J 

First, p half of the array with five e l 
the array with four elements is processed (No.^'V" be ' ng S P'" « 
a single element are produced). Fig 44 how ^e split, i,,j 

by mergeSort when it is applied to nine dZZT ‘ hC Sequent < 

Since merge operations cannot be done in „t 
addition to the main array, a[], ,n p ace ’ a second i 

The merge (.) algorithm takes three im 
among these parameters is : e ^ er paramet en r 


the 


operation of the 
W c 


ending ord< 
Ta y is indiv 


rithnr 


and ih 


> continues 
• of recursi 

temporary , 

P* V (middle] 


torith 

II l;tr • 


>way merge 
t it into two 
rted, and the 
Consider an 
' divides the 
illustrated in 


alf of 
lining 


The 


P ^ <2 < r 

It is assumed that the two subsequences of the array, a [] 


a[pJ / a[p + i] # 


and 


M<y] , 


a[<7 + 1] , a[<3r + 2] 


a [r] 


are both sorted. The merge() method merges the two sorted subarrays using the temnor 
array, tmp[]. It then coptes the merged and sorted sequence into the array at ^ 


a [p] / a [p + 1] , a [r] 

The mergesort() algorithm implements the recursive divide-and-conquer by taking two 
parameters: p and r (Initially, p = 1, r = n). These parameters specify the two subsequences of the 
array, a[] to be sorted. If the sequence to be sorted contains more than one element, the sequence is 
split in two, each half is recursively sorted, and then two sorted halves are merged by calling 
mergeQ algorithm. We assume that the two arrays a[] and tmp[] are globally declared. 


4.3.1. Analysis of Merge Sort 


In merge algorithm, the total number of iterations of the two while-loops, in the worst case, is 
r - p. The number of iterations of the third for loop is the same. Since all the loops do a constant 
amount of work, the total running time for the merge method is 0(n ), where n = r - p. This is the 
total number of elements in the two sub-arrays that are merged. 

We analyze the worst-case running time of mergesort on n elements. Merge sort on just one 
element takes constant time. When we have n > 1 elements, we break down the running time as follows. 

(«) Divide : The divide step just computes the middle of the subarray, which takes constant 
time, 0{\). 

07) Conquer : We recursively solve two subproblems, each of size n/2, which con.nbu.es Tin/ 
2) + T(n/2) to the running time. 

(in) Combine : The merge procedure on an n-elemenl subarray lakes time n 



A LGORITH M analysis AND D ESIGN | 


* 5 ? n" ' » «'). Thi. u . 

"" “* s,, “ *• ™” moc ' *■ 

- " 7i[,) = on) " iwTrri 

7’(/i) = 2T(n/2) + 0(/i) for n > 1 
This can be solved by repeated substitutions. Finally, 

Tin) = n log, n + n 
Therefore, the running time of merge sort is 0(n log 2 n). 

Algorithm 4.3. mergesort (pTr) 

1 . If (p < r) I 

2 - q = ip + r)/2 

3- mergesort <y) 

4 - mergesort (</ + |, r ) 

5. merge (/>. <y, r) 

6. Endif 


// Divide problem into subproblems 
// Solve first subproblem 
// Solve second subproblem 
// Combine the solutions 


I 


Algorithm 4.4. merge (p, q, r) 

1. i=j =p; k = ?+ 1 

2. While j < q and k < r 

3. If a(j] < afkj 

4. tmpfi] = a(j]; Increment i and j 

5. Else 

6. tmp[i] = afkj; Increment i and k 

7. Endif 
8 Endwhile 

9. While j < q 

10. tmpfij = a|j]; Increment i and j 

11. Endwhile 

12. For i = p to k 

13. a[i] = tmp[i] 

14. Endfor 


e time tor the merging operation is proportional to n, then the computing time for merge 
sort is described by : k & & 


[ 0 , 


T(n) = 


r (f] 


27| t* I + Cn, n > 1 


[C is a constant] 


i.e. n - 2 , we proceed as follows : 




= 2* t(-!L 


e that if 2* < „ < 


It is easy to 

T(n) 

therefore, jv t 

1.4. QUICK SORT 


2 * r (l) + * Cn 
^ = Cn log. 

'* then 
71(2* + ') 

0(n log n) 


As its name implies, quicksort is the l 
solely depends on the data it receives lf (he SOrting a,gorithm «n pra 


an be vt 


data has certain properties quid 
slow. Quicksort can perform quite fast. 


. a ' -> V ' U " pcnurm quite t 

degrading 0(,r). For quicksort, the worst a 


ice. The algorithm 
sort is one of the 
on average about 


case is usually when the 


fastest, if not, qu 
0(n log n), but its worst 
data is already sorted. 

is wr p ? a a n^ de , h a e n lZ qU TT a,e8y !° ^ 3 lis ' int0 ,wo sub -‘ ists Quicksort 

each of these sub-arravs The panition nr ln ° wo sub-arrays, and then restart the algorithm on 
the array - pivot)- If some other ohierf ^ ‘T V * S cho0sin 8 some ob J«t (usually, already in 

objIct°and 'the h ^ havmg enver ything that is larger than the chosen 

8 e ' cry "' i ” 8 “* is a *- — 

a 1S an . mleger of size ’ n The P and r invoke procedure and they are initialized 
witn 1 and n respectively; and are the current lower and upper bounds of the sub-arrays. The indices 
newleft and newr are used to select certain elements during the processing of each sub-array. Variable 
amid (pivot) is the element which is placed in its final location in the array. 


Algorithm 4.5. Quicksort (a, p, r) 

1 . newleft = p\ newright = r. 

2. amid = a [{p + r)/2] // pivot 

3. While newleft < newright // Partition 

4. While (afnewleftj < amid and newleft < r)U while loop- 

5. Increment newleft 
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6. Endwhile 

7. While (amid < af newright) and newright > p)H while loop-2 

8 Decremenl newright 

9. Endwhile 

10. If newleft < newright, then 

1 1. Swap (afnewleft), a fnewrighlj) 

12. Increment newleft and Decremenl newright 

13. Endif 

14. Endwhile // Partition ends 

15. If p < newright, then 

16. Call Quicksort^, left, newright) // sort left sub-array 

17. Endif 

18 . If newleft < r. then 

19. Call Quicksort (a, newleft, right)// sort right sub-array 

20. Endif 


Index p scans ihc list from p to r, and index r scans ihe list from r [o p. A swap is performed 
when p is at an element larger than the pivot and r is at an element smaller than the pivot A final 
swap w.th the ptvot completes the divide step. The pivot element is placed in its final proner 

~ arTa f WC ^ lhC piV °‘ aS ‘ he middle element of ,he a ™v for sub-array) We 

cons^an unsoned apy of size .2 to sort the array in ascending order : ,65. 35. 15. 90. 75. 1, 


. fM P i2 .’ ”f wlefl = P' newright = r, mid = (newleft + newwright)/2 = 6 amid - almidl 

r,-; jr, rr.irrr ~ s - • 1 “1 

P'VOI (45). 65 is lo be shifted lo r sublist The newlight°=Y > Thf ebi'i^ - f ^ tCMlUr ' 

<««■ "• ■ - i-h, 
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The subsequent steps are illustrated 
Table 4.2. 


Fig. 4.5. 


as follows (complete trace of 


Ihe algorithm is given in 







Table 4.2. Trace of Quick Sort. 
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ray 


The best case behaviour of the quicksort algorithm occurs when in each recursion step the 
partitioning produces two parts of equal length. In order to sort n elements, in this case the running 
time is in 0(n log 2 n). This is because the recursion depth is log 2 (n) and on each level there are n 
elements to be treated (Fig. 4.6 (a)). 

The worst case occurs when in each recursion step an unbalanced partitioning is produced 
namely that one part consists of only one element and the other part consists of the rest ot the 
elements (Fig. 4.6(c)). Then the recursion depth is n - 1 and quicksort runs in time 0(n ). In the 
average case a parlioning as shown in Fig. 4.6 (b) is to be expected. Both the best case and the 
average case are the same that is, 0(n Iog 2 n). 

The choice of the comparison element (amid) determines which partition is achieved. Suppose 
'hat the first element of the sequence is chosen as comparison element. This would lead to the 
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Even better would it be to take the 


* its: 


T W = e(nlog„) 



nn 




log 2 n 

T(n ) = Cn £l = C/iIogn 

1=0 

T(n) = 0(n Ig n) 

4.4.4. Randomized Quick Sort 

We have seen that if we assume all the permutations of the number to be equally likely when 
selecting the “divider” T{n) = @(n log n), we get the average case. We have to enforce the permutations, 
if we cannot assume all permutations to be equally likely. 

In Randomized version all permutations of the number are not necessarily equally alike depending 
upon the random-number-generator, Random ( a , b). Randomized version will show worst-case or 
average-case. Random (a, b ) returns an integer*, a < x < b. It is implemented with a pseudorandom 
generator. 

The randomized quicksort algorithm uses random (left, right) so as to obtain a new pivot 

element. 



^.5. MAXIMUM AND MINIMUM 

We are given a set of n elements and we have to find the two element. From the given set. One 
is the minimum element (smallest element) and the other being the maximum element (or largest 

element). 

To find either minimum or maximum element from the set of ‘/i elements we have to do 
(n - \) number of comparisons. 



I 




^ — 




in 4.7. Mlalmum (A) 


1. 

min ♦— A( 1 1 


2 

For 1 «- 2 to length |A| 


3. 

do if min > A|iJ 


4 

then mm *— AjiJ 


3, 

return min 


To find minimum anil maximum cl 


approach a 

a shown below using an algor 


^Igortthi 

n 4.8. MIN-MAX (A. p, r , 


1. 

if (p s r) then 


2 

max <-- A|p| 

*he n 

3. 

min <-- Afp| 

*ho ni 

4. 

else if (p = r - 1 ) then 


5. 

if (A|pJ > A|r|) then 

*ndm^ 

6. 

max <-- A | p J 

a sc or 

7. 

min <— AfrJ 

ndoin 

8. 

else max <— A(r) 


9. 

min <— AfpJ 

pivot 


« . . | p "i* r | 


10. 

else mid <-- L - J 

— 

II. 

MIN-MAX (A, p. mid. 


12. 

MIN-MAX (A. mid + 


13. 

if (min > mini ) then 


14. 

min <— mini 


15. 

if (maxi > max) then 


16. 

max <— maxi 


17. 

Exit 


nin, max) 
r, mini, n 


4.5.1. Analysis of MAX-MIN 

Total Time Complexity, 

T(n) = D{n) + R(n) + C(n) 

Din) = Divide time = 0(1) cons 
R(n) = Recursion time 


2r[ -r 


as each time 


sublists of equal size. 

Cin) = Combine lime = 0(2) as two compare 
in find min and max element. 


, arc required 




The no. of comparisons to find minimum and maximum value in an array is (2 n - 2) 
are maximum of (n - I) no. of comparisons for each operations. ' “ as 'hen 

If no. of elements is odd in an array, we will assume, that the first element of an an- 
minimum as well as maximum valued element, therefore the time comDlexirv nf ih,. i 
changes to v y OI me a| g°nth, 

m = 

2 2 

fi r ;:r: ber ofele ™ ents in an "»y is eve ". then there will an initial comparison between 
firs, two elements to find minimum and maximum valued elements. Hence * 

T(n) = I + = 3« _ 3« 

mSm 22-2 

|p.6. SUBSET SUM PROBLEM 

An instance of the subset sum problem is a Dair ( S i ) u,h™ c , 

exainly^o'the 5f va ^ ^ ^ ^ 


Wecan solve this problem using divide and conquer approach but actually i, is . Np., 


problem 

For example 


complete 


s = (I. 2. 3, 4) 
I = 5 


ADD 1 



Fig. 4. 




j~ Algorithm 4.10. Matmul (A, B, C ») 

1 . If n = 1 . then // base case 

2. C = C + A * B 

3. Else 

4. matmul (A, B, C, n/4) 
matmul (A. B + (n/4), C + (n/4). n/4) 
matmul (A + 2 * (n/4). B, C + 2 * (n/4), n/4) 
matmul (A + 2 * (n/4), B + (*/4), C + 3 * (n/4), n/4) 
matmul (A + (n/4), B + 2 * (n/4), C, n/4) 
matmul (A + (n/4). B + 3* (n/4), C + (n/4), n/4) 

matmul (A + 3 * (n/4), B + 2 * (n/4), C + 2 * (n/4), n/4) 
matmul (A + 3 * (n/4), B + 3 * (n/4), C + 3 * (n/4), n/4) 
Endif 


5. 

6 . 

7. 

8 . 

9. 

10 . 
11 . 
12 . 



( EXERCISES ) 


1. Modify the normal binary search algorithm so that in case of unsuccessful search it return 
index i such that A[i) < key < A\i + 1J. 

2. Design a divide and conquer algorithm to find the maximum and minimum of an array A of 
elements, and prove that the algorithm makes at most 3n/2 element to element comparisons * 

3. What is stable sorting method ? Is mergesort a stable sorting method ? 

4. Determine the running time of mergesort for 
(i) sorted input 

(«) reverse ordered input 
(Hi) random ordered input 

5. Trace the Quicksort algorithm to sort the list C O I / f r rr ill 

instance, where the Quicksort algorithm has worst' case comity" P ° rder Give “ 


( question s within swers 


Q a ' *7 a | nd 7 Pla,n ,he C0 " ,rol abs ‘~ for divide and conquer 

Ans. Control abstraction for divide and conquer • Dtvide t 

designing algorithms. These algorithms perform the foll<7 n °" qUCr " t0p - doWn ,echni «)“ ta 

(,) smS fT 1 - im ° SCVeral SUbpr0ble - «*>« af e similar to the original prob.eo, » 
(2) Solve the subproblem (recursively, successivelv and h 

<3> tSen these „ , ulWfa , ’ I 

solution to the original problem. 



Control Abstraction is an algorithm like structure It 

primary operations are specified elsewhere and hen d procedure wt >r 

liahorate the idea behind the divide anH tC unclear Let us i 


er (del 


strategy 


>se now is clear hut whose 
use a control abstraction to 


function thmt cm >oive p 


Q.2. 


pnniiu.v — I — vncwnere 

elaborate the idea behind the divide and c 

dc(P) 

( if (P is ■mall) 

return SlmplePunc (P) ; 

Else 

{ Divide P into smaller instance, p p 
Apply dc( , to each instance, *' 

Return comb. instances (dclP^, dc(P a ), 

} 

Modify the normal binary search algorithm sn rh a » „ 

index / such that AU) < key < A[i + f, 86 ° f unsuccessful ,, returns die 


tor k i i; 


<*c(P k ))> 


Ans. The following is a modified binary search algorithm - if the sp,r^h . . , , 

otherwise high. The index high (= „ satisfies the condition A[, Tkey < “ for l S3 
search. For unsuccessful case, the condition is : low > high - that is A|highJ < key < AfiS 
BinarySearch (A[l...n], key) 

1. low 1 ; high = n\ 

2. While (low < high) 

3. mid = (low + high) / 2; 

4. If (A[mid] > key), then 

5. high = mid - 1; 

6. else If (A(mid] < key), then 

7. low = mid + 1 ; 

8. else 

9. return mid; // found 

10. Endif 

11. Endwhile 

12. return high; // not found 

Q. 3. Devise a binary search algorithm which splits the set not into two sets of equal sizes but into two 
sets one-third and two-thirds. How does this algorithm compare with binary search ? 

Ans. TernarySearch (a[l. ..#»], /», x, low, high) 

1. low = 1; 

2. high = n\ 

3. while (low < high) 

4. p = (low *1- high) / 3; 

5. If (p < low), then 
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7. 

endif 

8. 

If (alpl > 

9. 

high = 

10. 

else If (alf 

II. 

low = | 

12. 

else 

13. 

return 

14. 

Endif 

15. 

cndwhile 

16. 

return - 1; 




10 return — i, // not found 

„ iit ihp ranee ( p < low), the statements 5 and 6 adjust the pointer p 
When the pointer p goes algorithm occurs when the recursive call is on 

(p = low). The worst-case running time, 1 (n) oi & 

the larger 2/i/3-element partition. 

i finrl the maximum and minimum oi an array A of n 

Q ‘ 4 ' elements anTprove thaX algorithm makes a, most 3,./2 element to element compansons. 

A„s Divide and conquer algorithm to find the maximum and minimum of an array A of n elements. 

' SuDD0St . we kn0 w the maximum and minimum element in both of the n ! 2 sized partitions of 

LT-demlt (. , 2) array. Then in order to find the maximum an 

array we simply need to see which of the two maximum elements is the larger and which of the 
^o rmnimum is the smaller. We assume .ha, ,n a .-element array die only one dementis both the 
maximum and the minimum element. Accordingly, we present the following algorithm for the 
maximum and minimum problem. 

We assume the array. A is declared globally. The algorithm is invoked with low - = I and high 
= n - that is, index of first element and index of last element respectively. And other two 
parameters are max and min which are initialized with first element. 

MaxMin (low, high, max, min) 


1 . If (low = high), then // case when n = 1 

2. max - min = A[low]; 

3. Else if (low = high - 1), then // case when n = 2 

4. If (Allow] > a[high]), then 

5. max = Allow], min = Alhigh]’ 

6. Else max = Alhigh], min = Allow]; 

7. Endif 

8. Else // case when n >2 

9. mid = (low + high)/2; 

10. MaxMin (low, mid, maxleft, minleft); 

11. MaxMin (mid + 1, high, maxright, minright); 

12. If (maxleft > maxright), then max = maxleft; 

13. Else max = maxright; 




|7. Endif 


Let T(n ) be the number of comparisons ex 
are no comparisons — that is T( 1 j = q Wh^i 
„ > 2, it is given as : 

Tin) = 


27 


t 2 J 


MaxMin perforins two recursive calls „„„ 

a,l! * one one p 

array, and then makes two further comparisons (ste 
minimum for the entire array. 


partition and anoth< 
ps 12 to 15) to am 


. When 


n of the 
turn and 


Since we expect T(n) to be a linear function, let Tin) = an + 

We have 7X2) = 1 and 7X4) = 27(4/2) + 2 = 27(2) + 2 = 20) + 2 = 4 
Hence 2a + b = 1 and 4n + h = 4, from which we get a = 3/2 and b = -2 
So 7(n) = ~-2. 

Q. 5 . What is a stable sorting method ? Is mergesort a stable sorting method ? 

Ans. Stable Sorting : Elements with the same value appear in the output array in the same order as 
they do m the input array. That is, ties between two elements are broken by the rule that whichever 
number appears first in the input array appears first in the output array. In other words, a sorting 
method is called stable if it preserves the relative order of equal keys in the array. 

Example : Unsorted array : 22, 44, 77, 11, 44,. 55, 66, 33 

Sorted array : 1 1 22, 33, 44,, 44 2 , 55, 66, 77, 

In this example, we have two equal keys (44). The relative positions of the keys 44, and 44, arc 
retained in the sorted array. 


Mergesort is stable. The elements comparison in merge includes equality so that the merge will 
be stable. Following figure illustrates the mergesort. Notice the elements : 44, and 44 2 . 
























Q. 6. Determine the running time 
(i) Sorted input 
(i7) Reverse ordered input 
(///) Random ordered input 
Ans. Mergesort sorts a given array ini' 
• Divide the array of size n . int 


• Sort nl and n2 by recursively 

• Now we have two sorted 


increasing order as fol 
iwo parts. For example 
n , = ihe first nJ2 element 

n 2 = th 
calling Merer 
contain ii 


\s in the array, 
remaining elements in the array. 

:>rt with each one. 
all the elements from the original array. 


rg C procedure to combine them, pul the result in the array 


The besl case running ..me of mergesor, is ^sorted ^n lst UJ ^ 

c^^Thc^ranning'timToT^hcm^gc^ort is given by the following recurrence re.aUon : 

7X1) = 0(1) for n = 1 


7X/i) = 27 f§) + <9(n) for n > 1 


• Divide : The divide step just computes the middle of the subarray, which takes constant time, 
00 ). 

• Conquer : We recursively solve two subproblems, each of size nl 2, which contributes 

^(f J + 12^) t0 running l ' me - 

• Combine : The merge procedure on an n-element subarray takes time O(n). 

The time taken for divide and conquer steps is the same for sorted, reverse ordered, and random 

ordered input arrays - that is 2T (^ j We have slight difference in merge step - that is, 0(n) 
The complexity of merge is as follows : 

• Every element in n, and n 2 is copied exactly once. Each copy is two accesses, so the total 
number of accesses due to copying is 2 n. 

• The number of comparisons could be as small as min (n., „.) or as large as (n - n F*4 

comparison is two accesses. B 1 V} ’ tacn 

• In the worst case, the total number of accesses is 2n + 2(n - I) = O(n) 

• In the best case, the total number of accesses is 2n + 2 x min (n, „,) 1 0 (n) 

The average case is between the worst and best cases and is therefore also O(n). 

Hence, the recurrence relation is T(n) = 2t{ -) + n<r,\ t . 

( 2 ) ° n for al1 the cases is the same. The 

running time of mergesort is 0(n log, n). 

Q- • Trace the Quicksort algorithm to sort the list C n 1 r r 

instance, where the Quicksort algorithm has wnr« ' L ' E ' C ' E in al P ha betical order. Give an 

*“• T “" « “* : s,„, ng g pi J " ,1“ 



The worst case occurs if given array 
one subproblem with n - 1 element 
w ill split array of length n, n - I, n 


1 = 0(n ). The worst cai 


ed The parttitioning routine 
nts. The successive calls to 
1 and ^^ing time proportional ton+(n- 


i also occurs if arr [1. 


2 ) + .... + 2 = t(n + 2) (n - 

order. 

Q. 8. List some of the relative advantages and disadvantages of the partition algorithm 
Ans . Relative advantages and disadvantages of the partition algorithm : 

The best case behaviour of the quicksort algorithm occurs when in each recursion step the 
partitioning produces two parts of equal length. In order to sort n elements, tn this case the 
running time is in 0(n log 2 n). This is because the recursion depth is log,(n) and on each level 
there are n elements to be treated. 

The worst case occurs when in each recursion step an ubbalanced partitioning is produced, 
namely that one part consists of only one element and the other part consists of the rest of the 
elements. Then the recursion depth is n - 1 and quicksort runs in time 0(n 2 ). Both the best case 
and the average case are the same that is, 0(n log 2 n). 

The choice of the comparison element determines which partition is achieved. Suppose that the 
first element of the sequence is chosen as comparison element. This would lead to the worst case 
behaviour of the algorithm when the sequence is initially sorted. Therefore, it is better to choose 
the element in the middle of the sequence as comparison element. 

Even better would it be to take the ^ th greatest element of the sequence (the median). Then the 

optimal partition is achieved. Actually, it is possible to compute the median in linear time.This 
variant of quicksort would run in time 0(n log 2 n) even in the worst case. 



'1 2 3 4 ' 

1 4 2 7 ' 


0 6 0 3 

3 13 5 

AB = 

4 112 

2 0 13 


0 3 5 0 

14 5 1 


n n 

Ans. We define the following eight ^ by ^ matr 


At i — 


Bn = 


A? i = 


Bn — 


1 2 

A 12 " 

3 4“ 
0 3. 

0 6 


_ 


'2 i 

1 4 
3 1. 

B n = 

} 5 
1 2 

'4 f 
0 3. 

A 22 = 

5 0 



'1 3 

'2 O' 

1 4 

Bn ' 

5 1. 



r 2 7l_[36 22j 
X t« 2J [58 47j 
_[l4 23] 
p, = (^21 +^22) Xfl H = [|4 23j 

' t -3 12 

p^ = A u x (#12 " ®22 ) = _|2 24 

r-3 2 

p = A 22 x(fl 2 > - Oil )- 5 -20 


34 18 

P 5 = (4 m + 4,2 ) x S 2 2 - 45 9 

P 6 = (A 21 -i4,|)x(Bn + B n > = 
p 7 = (/t l2 - A 2 j)X(fl 2 l + fl 22) = 
C,, = P l +/> 4 - P 5 +/> 7 = 

P, + P5 = 


3 27 

-18 -18 

18 16] 

3 oj 


17 22 
21 18 


C,2 


31 30 
33 33 


ft, +ft 


11 25 
19 3 


-22 “ ' 1 


P, + A>3 - /> 2 + P 6 


22 38 
14 30 


C = 


17 22 31 30 
21 18 33 33 
11 25 22 38 
19 3 14 30 


OBJECTIVE TYPE QUESTIONS! 


1. What are the three sequential steps of divide-and-conqucr algorithms '> 
(a) Combine conquer divide (fc) Divide combine conquer 

’ Divide conquer combine (</) Conquer divide conquer 



complexity of divide and conquer ^ '° a 'VP* of rec 
M Lr a, gorithin “ 


(fc) °<log„) 


(a) t *" ) 

(c) ” - (rf) 0(1 

The divide and conquer algorithm will have 

(a) Oi")' t (b) 0( | ( 

id) Q\ 


“n-ence relation What 


complexity 


<r) «" log . 

4 Thc divide and conquer strategy is uscd fof prt)b|ems ^ ( 


from — 

(a) 0(D 

( C ) 0 (n l°g n) 


sortin 


to reduce thc 


complexity 


“arch on a sorted , 


a y of 10 eleme 


(b) 0( log n 

r . W) 0(n 2 ) 

5 The average successful search time taken by binary se 
(fl) 2.6 (/>) 

(c) 2.8 {d) 2.9 

6 . Merge sort performs tn two phases : sort and merge. Wha, is the expected , r 

(a) <*"> (h) 0(log „) for mer 8 ln 8 ? 

(c) Oin log n) {d) 0(n 2 } 

7. Which one of the following is useful in implement.ng quicksort ■> 

(a) Stack ( b ) Set 

(c) List ( d) Queue 

g. The recurrence relation that arises in relation with the complexity of binary search is (where k is 
a constant) v 

(a) Tin) = TXnfl) + k ( b ) Tin) = 2Tin/2) + k 

(c) Tin) = Tin/2) + log in) (d) Tin) = T(n/2) + n 

9. Which one of the following algorithm design techniques is used in Strassen’s matrix 
multiplication algorithm ? 

(a) Dynamic programming ( b ) Backtracking approach 

(c) Divide and conquer strategy ( d) Greedy method 

10. In Strassen’s matrix multiplication algorithm (C = AB), if the matrices A and B are not of type 

2 n x2 n , the missing rows and columns are filled with 

(a) 0’s (b) Vs 

(c) — l*s ( d) 2’s 

11. In Strassen’s matrix multiplication algorithm (C = AB), the matrices A and B are decomposed into 
blocks. 

( a ) 2 ( b ) 4 

(c) 8 id) 16 . 

12. The median of n elements can be found in O(n) time. Which one of the following is correct 

the complexity of quick sort, in which median is selected as pi\ot 

(a) Q(n) (b) Q(n\og 2 n) 

(c) Q(n 2 ) (d) Q(n) 




Medians and 


Order Stetistics 


^.1. INTRODUCTION 

Order Statistics : / ,h order statistic 
clcmcnis is ith smallest clement. 



Medians : It is the middle element in the set of n 

( n + \ 1 

elements such that if n is odd median is | — - J element. 


otherwise if n is even then middle clement lies at / = ~ and i 


Example 5.1. Write an algorithm MEDIAN (S) to get the median element fr 
S of n elements. 

Algorithm 5.1. Median (S) 

n <— length [5] 
if (n % 2 - 0) then 

i «- L(n + l)/2j 

J <- T(n + l)/2l 

else 

i «— f"(n + l)/2l 

Time complexity if 0(1), as middle element can be found in constant time. 


Example 5.2. Find the median element in the following set S of elements : 


Solution. 


1933456778 


1 

2 

3 

4 

5 

6 


8 

9 10 

1 1 

9 

3 

3 

4 

5 

6 

n 

7 I 8 1 


Here, n = 10, i.e., even 



- n + I 


5 lh and 6th elements are median 


and 

median is 4. 5 


Write an algorithm to find the minimum and max. of element 


*]- 


Exfl 

11 

^gorithn, 5.2. Minimum (A) 


min 4 — A ( 1 ) 

2. for i <- 2 to length [A] 

3> do if min > A[i] 

4 then min <— A[i] 

5. return min 

Maximum (A) 

1 . max f- A ( 1 ) 

2. For i <— 2 to length [A] 

3 # do if max < A[i] 

then max <— A[i] 

5. return max. 


Running time of above algorithm is 6<n). as n - 1 comparisons are performed in w. 


ution. Assume that all numbers in A are interns (0 or I) that line 4 is executed 

J„ be « random variables where S, represents the no. of .terns 

ng the ith iteration of the loop. Where 

S = S, + S 2 + Sj + - + S » 

We have £ l x > = ~ ' 

1 . m is found ou, Of n elements each ..me is I . ^ each random vanahie 

Probability that maximum is touna 

n Mil) time, total expected time is 
nee MAX or MIN algo runs in (■ * 

£(0(n f ) = OaE(ni)}) 

(n - 1 


£0|£(n,)l = O (£*<"' 




if (A[i) > max) than max 4— A (1) 

• i "• if (A[i] < *in) than min «— All 

Best cave occur* when (he element* are in the increasing or tier 
i» n | . The worst case occurs when the element are in decreasin ' «i 
element comparisons is 2 (n - I » The averaee number it element 
I ). on the average. Atfl is greater than max half the time and so the 


Example 5.5. Show through a recursive MAXIM IN alt 
necessary in the worst case to find both the maximum an 

Solution. 

Algorithm 5.4. MAXMIN2 (i, J, max. min) 

if (i ■ j) than max f— min ♦— A [ 
2. else if (i - j - 1) than 
if (A[i) < A[ j] ) than 
max 4- A[j] 
min f- A f i J 
else 

max 4- A [i] 
min <— A[j) 

(i+j) - 

2 

Maxmin2 (i, mid, max, min) 
Maxmin2 (mid ♦l, j, maxi, mini) 
if (max < maxi) then max f— maxi 
if (min > mini) then min f- mini 


3. else mid = 


Iam us simulate MuxMinl on the following 


>n the 

1 follow in 

g set 

of el 

1 

- 

3 


5 

51 

13 

-5 

-8 

15 



A 





is best, average and worst case number comparisons when n is a po* Cr 


. 2 . SELECTION IN EXPECTED LINEAR TIME 

To find the ith smallest element, we can model RANDOMIZED-SELECT after quicksort a j 


Ft works on one side of partition. It uses procedure RANDOMIZED PARTITION and whose behav,f 
is determined by random-number generator. Its expected time is 0(n) 

Algorithm 5.5. RANDOMIZED-SELECT (A, p, r, I) 

1. if p = r 

2. then return A[p] 

3. q <- RANDOMIZED -PARTITION (A, p, r) 

k «— q - p ♦ 1 

4. if j £ k 

then return RANDOMIZED-SELECT (A, p, q, i) 

5. else return RANDOMIZED-SELECT (A, q+1, r, i-k) 

After RANDOMIZED Partition is executed, the array A[i .. r] is partitioned into two n 
empty Subarray A[p .. q) and A[q + I ... r] such that each element of A\p .. q] is less than e 
element of A[q + 1 .. rj. The algorithm computes the number k of elements in the subarray A[p 
The algorithm now determines in which of the following two subarrays A[p .. q] and A[q + j , 
the ith smallest element lies. If i < k , then the desired element lies on the low side of the paititi - 
and it is recursively selected from the subarray. If i > k then it is on high side. 

Algorithm RANDOMIZE-PARTITION produces a partition whose low side has 1 element with 

probability ~ and / element with probability £ for / = 2,3, ... n - 1 . If it is unlikely the ith element 
lies on larger side. Thus we have recurrence relation. 


+ 0(n ) 


T{n) < - T(max(l,n-1))+ £r(max(*,n-*» 


< - 
n 


k » I 

n-l ^ 


T(n - 1) + 2 £r(*) 
k =fn/2l 


+ 0(n) 


by induction. 


- ZT(k) + 0{ n) 

"r»/2i 


~ Z X ck + 0(n) 
*=r»/2i 


^ r./2i 'i 

X *- x * 


ma x(k,n-k); 


k if*>^ 
n-k if k<\ 





° two non- 
s than each 
ay A[p..q]. 
*[q + 1 .. r] 
le partition, 


EXERCISES 


1 Show that no algorithms based on comparisons uses less lhan - 2 comparisons i.e . MaxMin 
is optimal? 

2 Show that how quicksort can be made to run in 0{nlgn ) time in worst case 

3 Analyze SELECT to show that the no. of element greater that the median-of-medians x and th 

r n i 

no. of elements less than * is at least 1-1 if n > 38. 

4 Let X[1 n] and Y [1 .. n] be two arrays, each containing n numbers already m sorted order. Gr 
an O(nlgn) lime algorithm to find median of all 2 n elements in arrays X and Y. 

5 Find the best solution for I -dimensional post-office location problem, in which points arc simp 
real numbers and the distance between points a and b is d{a, b) - I a - b I 


□ □□ 
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i th element 
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if 
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Graphs 


* (in 


^.1. REPRESENTATION OF GRAPHS 

Before we give representation of graph let us provide 
the definition of adjacency matrix for a graph. 

Adjacency Matrix 

If G(V, E) is a graph then adjacency matrix is 
I VI x I VI matrix, i.e. vertex to vertex such that matrix 

A = [a^j and 

fl if (i,j) e E 

a — <j 

tJ [0 otherwise 

i.e., if there is an edge from V f to V J then entry to a tJ is I, otherwise O. See Fig. 9.1 
Its matrix is given by 


9.1. Representation of Graphs 

9.2. Traversing of a Graph 

9.3. Properties of DFS 

9.4. Applications of DFS 

9.5. Minimum Spanning Trees 

9.6. Shortest Path 

9.7. The Bellman Ford Algorithm 

9.8. Dijkstra's Algorithm 

9.9. Floyds Algorithm 







BFS DF S 


1 . 

The starting vertex is given to traverse 
a graph 

1 . 

No starting vertex is given. 

2. 

Uses queues to traverse a graph. 


Uses stacks to traverse a graph. 

3. 

A parent vertex is traversed first compared 

3. 

A child vertex is traversed first comnar a 


to its child vertex 


to its parent vertex. 

4. 

It is used to find spanning tree as well 
as shortest path. 

4. 

It is used to sort a graph. 

5. 

BFS doesn't uses recursion or backtracking. 

5. 

DFS uses backtracking. 


9.2.2. Breadth First Search 


As the name implies, before proceeding to the next level of tree or forest, nodes at current level 
are expanded first. This process is continued till the goal state is reached. 


9. 2. 2.1. Water-JUG Problem 


Let us consider that there are two Jug one of which can store 4-Gallons of water and the other 
3-Gallons of water we have to find a solution state such that the 4-Gallons Jug contains 2-Gallon, 
and 3-Gallons Jug contains no water (2, 0). We can throw the water and there is no scale for 
measurement on the jug. 

We can find the solution to above problem using BFS in terms of tree. Thus, to obtain the 
solution state (2, 0), we have to expand all the nodes upto level 6, such that it forms a complete tree 
See Fig. 9.3 below 




4 gallon 


□ 

3 gallon 


(a) 



( b ) 

Fig. 9.3 
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Fig. 9.3. 

Figure 9.3 shows breadth First expansion of water jug problem. 

9. 2. 2. 2. BFS Procedure 

Thus BFS expands the discovered or undiscovered node uniformly across the breadth. In order 
to mark the discovered and undiscovered node, colors are given as white, gray and black. 

(I) Node which is not visited is white. 


(2) Node which is visited but its child node are not visited is gray. 

(3) If all of its child nodes are visited than make it black. 


In BFS, we have to store the following for every vertex in the graph. 

(a) Color of the vertex as color [V\. 


(b) Distance of the vertex from starting vertex i.e. d[V ]. 

(c) Parent of the vertex i.e. n[V\. 


Let us consider the following undirected forest on which BFS method is applied using c< lor c 

techniques just described. Let us assign 0 value to the start node and infinity to all other nodes. 

Then measure the Unoo. r L t t Ipi also manage a queue, which 

„ • of f ' . lcn e l h from root to other levels as 1, 2, 3 let also maim* m 

consists oi nrst clemm. . . . « 

cni 48 node which is to be currently visited. 















Example 9.2. Simulate the Algorithm on the following graph with 


as a start' 



ni)(j e ' 


Fig. 9.7. 

Table 9.2. Trace of BFS. 

r — 


Block Niw 




) 


Fig. 9.8. Traversing of graph using BFS 

a 



0 0 © 

1 J /\ 

O © 0 © 

Fig. 9.9. BFS spanning tree. 


NOTE 

Queued tree we have t0 check that wheneven we deleted any vertex (a) from the 
taerteri * rac ' n 9 °* BFS algorithm, how many and which are the vertices (b) are 
*n the queue, then there is an edge a -> b exists in BFS tree. 




BFS (G . 

’• F °reach vertex u e v(G) - i 
j co * or \u\ <— white 

4 «] <~ <» 



6. d[S\ <~ 0 

7. set 0 <— (S’! 

8. while (0 * < 

9. do u <— dequeue (0) 
for each w G Adj [wj 

do if (color [v] = white) 
then color [v] <-- gray 
d[v] <— d[u] + 1 
7C[v) <— U 
0INSERT (0, v) 
color [w] <~ black 
Return 


9.2. 2.4. Analysis of BFS Algorithm 

We increment the path length on each visit, and color [v] gray and this child node is in^rt 
into queue, and the black node is deleted from queue. 

Each 0INSERT and 0DELETE or dequeue take, 0( I ) time, thus total time for queue one™;,, 
is O(v). Time taken to scan the edges in adjacent list is Ot£), so total time taken is 0(v + £). 

=. h I”V° SCa " th ? ^ ' S ° (E) 35 WC haVC '° Visit al1 ,he neighbouring node of all the vert„ 
and which is equivalent to number of edges is 

'£Adj(v) = 0(E) 

v € V(C) 

9.2.3. Depth First Search 



Fig. 9.10. Depth first exploration of a node. 
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Fig. 9.12. 

Ollltion. Assume that the starting vertex is S. 

Steps Used in DFS : 

' Initia,1 >' the vertices of graph have its color white. 

Assume a starting vertex and assign a discovery time (d) to this vertex and change its color 
t0 grey. 

Repeat until all the vertices of graph is not traversed. 

Check the neighbours of the vertex, which is just discovered (say VO. 



(b) If the neighbouring vertex of 'V* is not discovered then discover ii by ass | H 

discovery time to it and change its color to grey. ‘ 8nin E 

( c ) If all its neighbours of vertex ‘K’ are already discovered then finish the vc 
assign a finishing time and change its color to black. 

4. Exit. 

Note : 

1. If a vertex is white then the vertex is neither discovered nor finished (initial state) 

2. If vertex is grey, then the vertex is only discovered but not finished (waiting state) 

3. If a vertex is black, then the vertex is discovered as well as finished, (travesed state) 

4. The discovery and finishing time should always be assigned after increment it by on 
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Fig. 9.15. 

Solution. Assume vertex A as a starting vertex 







NOTE 


he most natural result of a DFS of graph is a spanning tree of the vertices reached 
ur, ng the search Fig. 9.17 shows the DFS spanning tree for the undirected graph 
9,1 ^he root of the trees is A, the first node visited. In fact, we can select any one 
he node as a root. Dashed lines represent back edges. The back edges in a graph are 
° Se tha * connect some descended node in a tree to an ancestor node in the same «ree t 
that if the graph is undirected then all of its edges are tree edges or oac — ge__ 
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ALGORITHM ANALYSIS AND DE Sjr^j 


Algorithm 9.2. DFS * 

1 . Initially color all vertex u € V(G) to white 

2. time <— 0 

3. For each vertex u € U(G) 

4. do if (color \u\ = white) 

5. then DFS_VISIT(«) 

Algorithm 9.3. DFS_VISIT(u) 

1. color [u J <— Gray 

2. time <-- time + I 

3. d[u] <— time 

4. for each V e Adj[w] 

5. do if (color [v] = white) 

6. then 7t[v] <— u 

7. DFS_VISIT(v) 

8. colour[w) <-- black 

9. time <— time + 1 

10. f[u] <— time 

9.2. 3. 2. Analysis of DFS Algorithm 

Running time for coloring white is 0(v) and visiting adjacent node means adjacent edges requires 
0(E) time as 

XM [*] = ©<£) 

veV(C) 

and since both are required so the running time is 0(V + E). 

9. 2. 3. 3. Edge Classification for DFS 

What about the other edges in the graph ? Where can they go on a search ? Every edge is either 

1 . A tree edge 


2. A back edge to an anchestor 



9. 2. 3.1. DFS Algorithm 



„„ any particular DFS or BFS of a directed or undirected graph, each edge gets classified 

ihc above. 


||.3. PROPERTIES OF DFS 
9.3.1- DFS and parenthesis Structure 

We can represent DFS method as parenthesis structure in which when a vertex is visited we 
write opening brace *( ’ and when it is fully explored we write closing brace ‘)\ 







Solution. 


Fig. 9.19. 
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9.3.2. Parenthesis Theorem 

For .wo vertices „ and v of a graph G(V, £), one of ,he following conditions may holds 
(a) The intervals (</[«],/[„]) and (<*,], /[w]) are disjoim 

(b, The interval (4«],/M) is entirely within (d[v] /M) 

<r) The interval (44. /[v]) is entirely within (d [u] f [u]) 








For l wo vertices u and v 


1 S™pl> G(V. £). ,h. 


die ven 


“ s in the P“lh from u to r are while. 


vertex u is discovered. 

Jp.4. APPLICATIONS OF OFS 
9.4-1- Topological Sorting 

A graph G(V, E) is said to be tnrs,vi~„ , 

topological sorted if t 

(i) graph G should be directed m-vrii attsfies the following conditions 

«L>L||C nronU ix. n 


when 


ild h.« K Ph '*■ DAG 

lM ^ ,n * n «ive (No sclf looM , 


v \ The graph 


iical sorted, it nil its 
ices in if 


orted graph, should | nged ,n a honz ontal line and all 
1 a ways have its direction from left to 


Example *.*. Give* a graph G % with I V I number of 

1 en,CM and I £ | number of edges. 


Solution. Me 



Fig. 9.21 
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Fig. 9.22 

cue fl using a linked list wiih Ironl and rear pointers and as the vertex i 
tie. insert il onto the Ironl *>• J 4 ucue> 0- 




algorithm analysis and 


{a) Initially ucue 0 is empty °JT] 

<l>) Vertex D gets its finishing time, insert it onto the front as 



(d) Vertex G got finished. 




























Fig. 9.24. Topological Sorted Graph 
9.4.1. 1. Algorithm of Topological Sorting 

Algorithm 9.4. Topological-Sort (G) 

(1) CALL DFS (C) to compute finishing time/]v] for each vertex v 

(2) As each vertex is finished insert it onto the front of a linked list based queue 

(3) Return the linked list of vertices. 


9.4. 1.2. Analysis of Topological Sort 

We can perform a topological sort in time 0( V + E), since depth-first. Search takes 0(V + E) 
time and it takes 0( 1) time to insert each of the I V I vertices onto the front of the linked list 

9.4.2. Strongly Connected Components 

A strongly connected component (SCC) of a directed graph G(V , E ) is a maximal set of vertices 
C c V such that for every pair of vertices u and v in c. we have both n *»+ v and v u\ that is 
vertices u and v are reachable from each other. 


Example 9.7. Given a graph G( V, E ) with I V I number of vertices and I E I number of edge 



Fig. 9.25 


Solution. 

Step 1 : 

time of each 


Apply DFS(G) on 
vertex in the graph. 


iven graph G(V. E) to compute the disc 
• fi* n starting vertex. 


•very 


and finishing 





G t = (V, £ r ), where 
E t = {(m, v) : (v, u) e E) 


i.e. E t consists of the edges of G with their directions reversed. 



Fig. 9.27 

Step III . Again apply DFS (C ) and compute all vertices’s discovery and finishing time by 
selecting the starting vertex, according to their decreasing f[u\ in the graph G. 




(a) .Select vertex ‘h' su a star 
(fr) Now select vertec *c* as i 
vertices 

(r) Now select vertex i, 

f</) Finally select vertex /i as 
Step IV : Output the vertices 


r em4intn< 


hat 



X 


.... SJS 

,*• — '•■»« Component, 

9 -‘; «•—« Componnnt* 

I (l> Call DPS (G) to compute Imdimp limes /|„| for eash 

(2) Transpose the graph 67- and compute G r . 

(3) Call DFS (G ), hut in the main loop of DFS Conud-r ih 

decreasing f[u\. ' consider the star 

| (4) Output the vertices of each tree m d epth-first forest formed in l.n 

9.4.2.2. Analysis of Strongly Connected Components 

Given an adjacency list representation of G. the lime to create G T is a 
<o observe that G and G 7 have exactly the same SCC S , 

rielT: CO 'T meS ‘ he slron 8*>' connected 
iwo depth-first searches, one on G and other on G r 

0’S. MINIMUM SPANNING TREES 

In the design of electronic c.rcuitry it is often necessary to make the p.n 
<• ei rtcally equivalent by wiring them together. To interconnect a set of 
arrangement of (n - I) wires, each connecting two pins of all such arrangei 
the least amount of wire is usually the most desirable. 

We can model this wiring problem with a connected, undirected graph G = (V E) where V ,s 
he sc, Of P'ns. £ IS the se, of possible inierconnecttons between pair's of pms. and for el edge 
1 1 \ w i r,„ a fmd a We,eh, ? V) lhe «* (amount of ware needed, to conll aS v 

li.mmld ^ SUbSC ' rC£,ha ‘ C ° nnCC,S a " ° f ,he vcn,ccs and * h <>* -ei S h, 


£). It 


:ar-time 
L'ranh C 


I components 
e can use an 
one that uses 


k(7) = (u,\ 





Since r is acyclic and connects all of the vertices, it must form a tree or just a connected g raph 

I, rvinnirtff tree Wc can call the problem of determining T as the minimum, 
which we can all a spanning tree. wc c*. . 11 

spanning tree problem i.e. a spanning tree w.th minimum cost or weight w(T) called minima,, 

spanning iree^lMSTf ^ ^ dgorilhm for solving the minimum spanning tree problem U. 

(a) Kruskal’s Algorithm 
(/?) Prim's Algorithm 


9.5.1. Kruakal Algorithm 

Consider the arcs of the distance network of a given problem. If the network is undirected, 
then it is sufficient to form a table summarizing the distance of each arc (/, j ) in the network, 

only for i < j. 


9. 5. 1.1. Kruskal Algorithm 

The step of Kruskal’s algorithm are presented as follows : 

Step 1 : Input the following : 

• Number of nodes in the network, /?. 

• Distance matrix (if there is no arc between any two nodes, then set the distance between 
them to infinily/a very high value. Also set the diagonal entries as infinity/a very high 

value. 

Step 2 : Arrange the arc along with their distance as per ascending order of their distances let 
this arrangement be called as set M. 

Step 3 : Create a graph with n nodes without arcs. 

Step 4 : Select the next undeleted arc (first undeleted arc on first pass of this statement) from 

the set M. 

Step 5 : Check whether the inclusion of the selected arc in the previous step into the graph 
forms a cycle. If yes, go to step 7, otherwise goto step 6. 

Step 6 : Include the selected arc into the graph. 

Step 7 : Delete that arc from the set M. 

Step 8 : Check whether all the nodes in the graph are connected. If no, go to step 4, otherwise 

go to step 9. 


Step 9 : Stop. 


Example 9.8. Consider the networks given below'. Find the minimum spanning tree using 

Kruskal's algorithm ? 
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solution. 

Step 1 : Since the network is undir^ , 
l0 Table below ec,C( i, the 


Arc 

1-2 

1-3 

1- 4 

2- 3 
2-6 

3- 4 
3-5 
3-6 


Distance 

15 

10 

9 

4 
13 
6 

5 
7 


4- 7 

5- 6 
5-7 

5- 8 

6 - 8 
7-8 


Ween 
:f > high 1 

Arc 

2-3 

nces let 

3-5 


3-4 


6-8 

) from 

3-6 

graph 

4-7 

1-4 


1-3 



shown be 


Arc 


TT 1 

1 t 

5-7 

1 1 
1 2 

2-6 

1 3 

4-5 


1-2 

15 

5-8 

15 

7-8 

20 


■ U I 

Step 3 : Figures below show s step 3 onwards Thp r -> " 

vise areinduded one by one. The tree in last fim,™ ic .h LS F ° m " 10 ^ * rom the lable above 

sum of the distances of the arcs in it is 45 minimum spanning tree and the corresponding 


in g 







Pig. 9.31. Partial spanning tree after adding arc 2-3. 
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Fig. 9.32. Partial spanning tree after adding arc 3-5 



Fig. 9.33. Partial spanning tree after adding arc 3-4 



Fig. 9.34. Partial spanning tree after adding arc 6-8. 
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Algorithm 9.7. MST-Kruakal (G, w).. 

1 . A <— 0 — 1 ■■ i 

2. for each vertex v e V(G) 

3. do MAKE-SET (V) 

4. sort the edges of E into non-decreasing order by weight w. 

5. For each edge («. ,-) e E, taken in non-decreasing order by weight. 

6. do if FIND-SET (//) * FIND-SET (v) 

7 * then A <-- A u {( w , v )) 

8 - UNION (/<. v) 

[ 9. Re turn A. 

each KrUkSal " al8 ° rithm> initia ll.V initialize the set A to the empty set and create I VI trees or sets. 
l co ” ta,n,n g one vertex. The edges in E are sorted into non-decreasing order by weight and may 
** slored a queue in line 4. 


and hA* ^* ne ^ c ^ ec ^ s ^ or an edge from the queue i.e. (k, v), whether the endpoints u 

must be °d T l ° l * le same set ’ ^ ^ e >' are * lhen ihe edge (“• v ) must be discarded, otherwise the edge 
W to set A and the verteces of the two sets are merged together in line 8. 




ALGORITHM ANALYSIS **~ 



ihC = (V. £) depends on the implcm-- 
,cs Ol I ) time, and the time to sort 



UNION operations on disjoint 


In loop 2-3, there are I V I mak 


ations. 


Hence the total time 


- T j + r ilcp2 . 3 + * stev 4 + * step 5-8 

= 0( I ) + 0(v) + ^ log + WE) 


+ 7‘ lm4 + r t( 


As G is a 


assumed to be connected, hence we have 


I £1 > I VI - 1 


therefore 


O(V) + 0(E) = 0(E) 


Hence the total time = 0(E) + 0(E log E) = 0(E log E) 

If I El < I VI 2 , then log E = 0(log VO 
then the total time = 0(E log VO- 

9.5.2. PRIM Algorithm 

The PRIM algorithm is used to the find solution for the minimum spanning tree problem The 
steps of this algorithm are presented as follows : 

Step 1 : Represent the distance network in matrix form (if there is no arc between node i and 
node j, then set the distance between them to infinity/a very high value. Also, set the diagonal 
entries of the distance matrix to infinity/a very high value.) 

Step 2 : Let Q - [Null set) which is the set of selected row numbers of the matrix. 

Step 3 : Select row 1 and include it in Q. Then, delete column 1 of the matrix. 

Step 4 : Find the minimum of the unselected values among the rows in Q and select it by 
marking a square around it (in case of tie, break, it randomly). 

Step 5 : Identify the corresponding column number ( K ) and then include it in Q. 

Step 6 : Delete column K of the matrix. 

Step 7 : Check whether all the column are deleted. 

If yes, go to step 8, otherwise go to step 4. 

Step 8 : Show the arcs in the spanning tree corresponding to the cells of the matrix marked 
with squares by thick lines. 

Slep 9 : Find the sum of all the distance values marked with squares. This is the minimized 
total length of the arcs to connect all the nodes of the network as per the minimum spanning tret 
concept. 

Slep 10 : Stop. 


Example 9.9. Consider the distance network shown in Fig. 9.36, which is reproduced belo» 
•n Fig. 9.38. Find the minimum spanning tree of the this network using the PRIM algorUl"" 
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solution 

Step 1 : The ma,n * f ( *m of the divi 

Table 9.3. Dia 


Node I 


10 

9 

15 


2 

10 


I I 


Step 2 : Q = {Null set). 

Step 3 : Q = { 1 ). The matrix after deleting column 1 is shown in Table 9 
tables, each of the rows in Q is indicated by *. 

Table 9.4. Distance matrix after deleting column 1 (Exampli 




ALGORITHM Al 


" . . ce |i values of the row in Q is 9. So, it is marked ZJ 

, 4 : The minimum of the undelete (fc) wjlh respec , , 0 the minimum di sta J 

a square as shown in Table 9.4. The corresp 

" V I : £ — 3 “ — * “ rMc 95 

w ■ ZZZ . ”'“ m " 3 (Ex ■"" , '• 9 - 91 

Node j 


Node i 



Step 7 : All columns are not deleted. So, go to step 4. 

Step 4 : The minimum of the undeleted cell values of the rows in Q is 7, it is marked with , 

square as shown in Table 9.7. 

Step 5 : K = 5 and Q = {1, 3, 5} 

Step 6 : The matrix after deleting column 5 is shown in Table 9.6. 

Table 9.6. Distance matrix after deleting column 5 (Example 9.9) 


Node j 

2 4 6 7 8 



Step 7 : All columns are not deleted. So, go to step 4. 

Step 4 : The minimum of the undeleted cell values of the rows in Q is 5. So, it is marked with 




Step 5: K = 2 and Q = ( | 

Step 6 : The matrix after deleting column 2 k «h 

L ,s sh °wn in Table 9 7 

Table 9.7. Distance matrix after deleting column 2 (Exampla S. 9 ) 


Node j 
7 


Node i 


15 

oo 

oo 

oo 

11 

oo 

oo 

oo 

oo 

0 

oo 

oo 

- 

oo 

6 

15 

9 

14 

16 

oo 

oo 

- 

10 

12 

6 

10 

- 

4 

15 

12 

4 
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Step 7 : All columns are not deleted. So, go to step 4. 

Step 4: The minimum of the undeleted cell values of the rows in Q is 8. So, it is marked with 
a square as shown in Table 9.7. 

Step 5 : K = 6 and Q = (1, 3, 5, 2, 6). 

Step 6 : The matrix after deleting column 6 is shown in Table 9.8. 

Table 9.8. Distance matrix after deleting column 6 (Example 9.9) 

Node j 

4 7 8 


Node i 


* 1 

15 » 00 

* 2 

11 00 00 

3 

00 00 00 

4 

6 15 

♦ 5 

[~9~| 16 

• 6 

00 10 12 

7 

6 - * 

8 

15 4 



Step 7 : All columns are not deleted. So, go to step • 

SUP . , The minimum „f Ihe unbeleie. cell clue, of lb. ro« » Q * »• 

square as shown in Table 9.8. 






Node 


Node j 
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[T| 

16 

10 


15 

oo 

12 
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Step 7 : AH column are not dieted. So, go to step 4. 

Step 4 : The minimum of the undeleted cell values of the rows in Q is 6. So, it is marked w rh 
a square as shown in Table 9.9. WIUl 

Step 5 : K = 7 and Q = {1. 3, 5, 2, 6, 4, 7) 

Step 6 : The matrix deleting column 7 is shown in Table 9.10. 

Table 9.10. Distance matrix after deleting column 7 (Example 9.9) 

Node j 
8 


Node I 


4 

5 

6 

7 

8 


15 

oo 

12 

0 


Step 7 : All columns are not deleted. So. go to step 4. 
a square as shown in Thble 9.\& Undcle,ed cel1 va,ues of the rows in Q is 4. So, it is marked with 

Step 5 : * = 8 a nd 0 = , | 3 5 2 6 4 ? 8) 






Algorithm 9.8. MST-PRIM (G, w, /) 

1. For each u e v(G) 

2. do key [m] <~ oo 

3. n[u] < - Nil 

4. Key [r] <~ 0 

5. Set q <~ v(G) 

6. While (q * <J>) 

7. do u <~ EXTRACT-MIN ( q ) 

8. for each v e AdjfwJ 

9- do if v e q and w (m, v) < key [v] 

10. then n [ vj <— u 

1 1- key [v] <- w (w, v) 


Prim’s algorithm, initially in line 1-5. Set the key or distance of each vertex to «• (except the 
root r , whose key is set to 0), set the parent n of each node to Nil and initialize the minimum priori' v 
queue ‘ q ’ to contain all the vertices. 

Loop 6-11 repeatly extract a vertex from the priority queue, which is having the maxinoim 
priority and compare the existing distance of each vertex v, with the new distance found out using 

the following : 

(a) Suppose there is an edge (//, v) then existing distance is represented by key [v] while the 
new distance can be determined using the vertex u i.e. key [«] + w(u, v) and whichever is 
less or minimum assign that value to key [v). 


cm 

9. 5. 2.2. Analysis of Prim’s Algorithm 

The performance of Prim’s algorithm depends on 

queue q. 


ALGORITHM ANALYSIS ANO OESlQn I 


how we choose to implement the priority 


Definitions 

Sparse graphs are those for which 


than I V I 2 i.e. I E I « 1 V I 2 , we prefer* 
* case. On the other hand, dense gTaph are tho* 
like to represent graph with adjacency matr 


| E I is much W 

the adjacency list representation of the graph in thi 
for which I E\ is close to I VI 2 . In this case, we 

representation. 

(a) When a *</’ is implemented as a binary heap We can use the Bb procedu 

perform ihe initialization in line 1-4 in 0(1 VI) time. The v. v i e in me 
I VI times, and since each EXTRACT-MIN operation takes 0(log I VM) time, the total t,m 
all calls to EXTRACT-MIN is 0(1 VI log I VI). The for loop in line - i cu ed 0( 
times. Since the sum of all the neighbours of all the vertices are equivalent to number of e 

in the graph i.e. 

£ Adj (v) = O(E) 


The assignment in line 1 1 involves an implicit. DECREASE-KEY operation, which takes Odog 

I VI) time. 

Thus the total time for prim’s algorithm using binary heap 

= 0(1 VI log I VI) + 0(1 £ I log I V I) 

= 0(1 VI log I VI + I £1 log I VI) 

(b) When ‘ q ’ is implemented using Fibonacci heap : In this case, the performance of the 
DECREASE-KEY operation implicitly called in line 1 1 will be improved. Instead of taking Oflog 
I VI) time with a Fibonacci heap of I VI elements, DECREASE-KEY takes 0(1) time, therefore 
the total time = 0(1 VI log I VI + l£l). 

(c) When graph G = (V, E) is sparse : l£l = 0(1 VI) from above description, it can be seen that 
both versions of prim’s algorithm will have the running time 0(1 VI log I VI). Therefore, the Fibonacci 
heap implementation will not make prim’s asymptotically faster for sparse graph. 

(d) When graph G = (V, E) is dense : From above description. We can see that prim’s algorithm 
with binary heap will take 0(1 VI 2 log I VI) time whereas with Fibonacci heap, will take 0(1 VI ) time. 
Therefore, Fibonacci heap implementation doesn’t make prim’s algorithm asymptotically faster for 
dense graph. 


Example 9.10. Prove the correctness of PRIM’s Algorithm ? 

Solution. Prim’s algorithm always yields a MST. We can prove it by induction. Let 7 0 be a part 
of any MST which consists of a single vertex. Assume that £ _ , is a part of MST. We need to prove 
that T r generated by 7-_, by Prim’s algorithm is a part of a MST. Assume that no MST of the graph 

can contain T r 

Let e { - (m, v) be a minimum weight edge from a vertex in 7, _ , to a vertex not in 7, _ | used by 
Prim’s algorithm to expand T l _ l to £.. By out assumption, if we add e to 7, a cycle must be formed 
In addition to the cycle must contain another edge (v', u). If we delete the edge e. (v\ m'F dien 
we obtain another spanning tree. Now we have w ei < w ek . So, weight of new spanning tree is l* ss 
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Suppose G be a weighted directed graph where a minimum labeled w(„ v) associated with each 
edge («. v) in E, called weight of edge (u, v). These weights represent the cost to traverse the edge. 
A path from vertex u to vertex v is a sequence of one or more edges. 

< (V,, V 2 ), (v 2 . v 3 ) (v„_ v„)> in E(G) 


where 


u = v. and v = v 


The cost (or length or weight) of the path P is the sum of the weights of edges in the sequence 

The shortest-path weight from a vertex me V to a vertex v € V in the weighted graph is the 
minimum cost of all paths from u to v. If there exists no such path from vectex u to vertex v then the 
weight of the shortest path is «>. 

9.6.1. Variant of Shortest Path Problems 

(1) Single-destination shortest paths problem : Find a shortest path to a given deslinatic 
vertex / from each vertex v. By reversing the direction of each edge in the graph, we cs 
reduce this problem to a single-source problem. 

(2) Single-pair shortest path problem : Find a shortest path from u to v for given vertices 
and v. If we solve the single source problem with source vertex u, we solve this proble 
also. Moreover, no algorithm for this problem are known that run asymptotica y ast 
than the best single-source algorithm in worst case. 

(3) All-pairs shortest path problem : Find a shortest path from u to v tor e ^ r J p . 
vertices « and v. Although this problem can be solved by runntng a stngle source algont 
once for each vertex, it can usually be solved faster. 


9.6.2. Negative Weight Edges 

The negative weight cycle is a c 
.i venex on the cycle can be a shortest path. Since a path can ^ n . a ^°^ ^ not i 0 n of dista 

1 ne fcative cost desired, in other words, a negative cycle invalidates the 
eights. 


The negative weight cycle is a cycle whose total is negative^. c ^ cle many time s 


based on 
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cle 

d# 


rw h rciax at ‘ on 

^ . distance of vertex v from source 

#*'1 parent of vertex V. 

rfvl •* ** P 

_ -t path Algorithm 

. i SH or ** 1 

J.*' ^ orized shortest path algorithm into two categories depending on the 

-ju categ 

* source shortest path, where only a single source is given and we ha 

(I) S,n& path of each vertex V from the source 5. There are two basic algo 
^source shortest paths are : 





) What is graphs. Explain how the graph are represented 
2. Difference between BFS and DFS ? 
x Discuss the application of DFS. 

4. What is parenthesis structure, 
v What is white-path theorem. 

6. Difference between Prim’s and Kruskal algorithms for finding maximum spanning tree ? 

7. Why Dijkstra algorithm does not support negative weighted edges in a graph. 

8. What is shortest path ? Explain all its techniques with their complexities. 

( "questions with answe rsm 

Q. 1. Find the shortest path between all pairs of nodes in the following graph. 



Ans. A k (i,j) = + A k -' (k,j),C(i,j)} where n = 4. no. of nodes 


for k = 1 
1 




12 3 4 

1 

0 5 4 1 

2 

5 0 2 3 

3 

4 2 0 6 

4 

13 6 0 


1 

2 


a\ 1, 1) = 
V(l,2) = 


mm [A°(l, 1)+A°(I, |).0(1. I)] = min [0 + 0,01 = 0 
min [A°(l, 1) + A°(l, 2)i C(l, 2)) = mi n [0 + 5. 5) = 5 





Sinn 
done i 


larly. 


I ' n u. J),C(i 

4 A 0.4) = min [A°(|, |) + / ,o (| 

for other values need to compute likewis 


<». 4 )] = 

• f or those value 

A ] (i, 4) = min |4°<3. I ) + V>< 1 . 4) . C (3 4j , . 
A <4. 3) = min |/t°(4. 1) + A°(l. 3) , C(4 ' 3)| ' 


that t 


min || 


■1.11- I 

changed hav< 

H.6J-S 
► 4. 61 - s 



Thus. A 1 matrix is obtained will be the input for A 2 . 

In this iteration values of matrix doesn’t change but needs to 

k = 2- 


compute for next iteration i.e., 


0 

5 

4 

1 

5 

0 

2 

3 

4 

2 

0 

5 

| 

3 

5 

0 


,n this iteration values of matrix doesn’t change but needs to compute for next iteration i.e., 


5 0 2 3 
4 2 0 5 
13 5 0 


Finally. A 3 is the resultant values for all pair shortest path. 


Q. 2. What is a spanning tree ? Show' that a simple graph is connected if it has a spanning tree. 

Ans. A spanning tree of a connected graph is a spanning subgraph that is a tree. A spanning tree is not 
unique the graph is a tree. Spanning trees have applications to design of communication networks. 

A spanning tree of an undirected graph of n nodes is a set of n - 1 edges that connects all nodes. 
Consider the following connected, undirected graph and notice the number of edges. Also, each 
node is reachable from every other node. A spanning tree can be obtained by using either DFS or 

BFS. 



Fig. 9.51. An undirected graph 
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Fig. 9.52 

Minimum spanning tree have many applications. Some are 
(0 Building cable networks that join n locations with minimum cost. 

(ii) Building road network that joins n cities with minimum cost 

(ill) Optimizing computer networks. 

(rv) Obtaining an indpendent set of circuit equations for an electrical network. 

(v) In pattern recognition MST can be used to find noisy pixels. 

Q. 4. Prove that the edge with the smallest weight will be part of every minimum spanning tree. 

Ans. Edge with the smallest weight will be part of every minimum spanning tree. 

Let u-v be the smallest weight edge. Pick any minimum spanning tree T If the edge is in 7, we are 
done. So assume that the edge is not in T. But then when we add u-v to T. we get a cycle. Pick any 
edge on the cycle other then u-v and remove the edge. The weight of the resulting subgraph is 
less than or equal to the weight of T. Moreover, the graph is a tree since it is connected and has 
n - I edges (/i : number of vertices in the graph). Kruskal’s algorithm builds MST. The first edge 
that we add to T will be the smallest weight edge in the graph Hence, the smallest weight will be 
part of every MST. 

It is observed from the following figure that the minimum weight edge (weight = 2) of the graph 

is included in three minimum spanning trees. 
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II initialize Q with all vertices as UNKNOWN 


4. 

5. 

6 . 

7. 

8 . 

9. 

10 . 
11. 
12 . 


& marking it as KNOWN 


2. Q*~ V 

3 While Q not empty do 

u DeleteMin (Q) " Q modified 

Mark u as KNOWN II Dequeing w is the same i 

For each vertex v in Adjlu) do 

If v is UNKNOWN and 6\v) > weight (u, v), then 

dlvl = weight («. V) II update with smaller weight 

plv j su II update v’s parent as v 

Endif 
Endfor 

12. Endwhile. , oriontY queue is implemented as a min- 

asr *« * — . 

algorithm. ^ ^ fo , lowjng graph . using Prim's algorithm under th 
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Adjacency list : 


x : null 


v 2 ' 

v 3 ” 

Va* 


l“* v * 

'o^v 2 -*v 3 - 

k»!->V 2 ^V 4 


>V 0 -^V,-^ V 3- 








Fig. 9.55. 
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by weight a ' ^ A) baSCd ° n the structure of the £ ra P h and the order of edges when ordered 
tree ' h SSUme ^ or moment that this MST is not unique and that there is another spanning 
are so ^ Wei ^*' ^ l bere are n ver tices in the graph, then each tree has n -1 edges. There 

tfthes 116 C ^ eS w ^ ,c ^ belong to B but not to A. What happens if we decrease the weight of one 
0 f { j^ Se ed £ cs hy a smaii amount e so that we do not change the overall ordering of all the edges 
w ben ordered by weight ? (This is possible because all weights are separated by 
B ^,j| amounl s). It will not change the result of our algorithm, which still gives tree A. But tree 
contr a n0VV ^ ave a weight e less than what it has before, which means that A is not minimal, 
thcr t tan k* assum P^ on - Because of this contradiction, we conclude that the assumption that 
a se cond MST weas false. 
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Q. 8. What is the basic difference between Prim’s and Kruskal’s approaches to obtain minimum spanning 
trees ? Illustrate the results for the following graph : 



1 

Prim’s Algorithm 

Kruskal’s Algorithm 

1 1. Build MST one vertex at a time. 

2. Start with one vertex tree T. 

3. Add the edge of minimum weight among 
those with one vertex in T and the other 
not in T. 

The followino .. l 

1. Construct MST one edge at a time. 

2. Sor the edges by weight. 

3. Build a spanning forest (that eventually 
becomes a tree) by adding the edge of 
minimum weight which when added to 
those already chosen does not form a cycle 


^q|J — _ / uvica nui ivmii* ** v / _ 

minimum cost is^lSS VVS ^ Stagcs of Pr ' m s MST algorithm (starting vertex is I). Total 





Fig. 9.59. 


[objective type questions) 


1 . 

2 . 

3. 

4. 

5. 


Insertion of an edge to a spanning tree form a 

(a) Circuit (*>) Cycle 

(c) Open path (d) Binary tree 

A spanning tree of an undirected graph of n nodes is a set of edges that connects all 

nodes. 

(a) n - 1 (b) n - 2 

(c) n (d) n + \ 

In traversal the adjacent nodes of a nodes of a node are visited First. 

(a) Inorder ( b ) Postorder 

(c) Breadth first search (d) Depth first search 

Using the depth first search the edges are traversed by search algorithm to make a tree called as 
{a) Breadth first spanning tree ( b ) Depth first spanning tree 

(c) Spanning tree ( d) Weighted graph 

If the starting node is l a\ the DFS of the following graph is 

(a) a-b-c-e-d 

( b ) b-e-d-a-c 

(c) b-e-a-d-c 

(d) a-c-b-d-e 



6 . 

7. 

8 . 
9. 


Fig. 9.60. 


In the implementation of DFS data structure is mostly used. 

(a) Stack (fc ) File 

(c) Array (*/) Queue 

DFS on a graph with n vertices and m edges takes time. 

°( mn '> (b) 0(n + rn) 

(c) O(m-n) (<f) 0(m-n + 1) 

The running time of BFS on a graph with n vertices and m edges is 0(n + m) 

[ a) 0imn) ( b ) 0(n + m) 

g 0(m ~ n) (d) 0(m-n+\) 

num er of edges that must be removed from a connected graph with n vertices and m edE* 5 
to produce a spanning tree is 

(a) m ... 

\b) n-m 

(c) m-n + I / r\ 

(d) m-n 







II. A direct* .d (r.pt, h „ , 

cycle if and only if j 

(a) tree 
(c) cross 

jj. Which of Ihe following is useful m travi 
(a) alack 

( c ) list ( J ' CT 

|3. Ul T he a depth first search ircc in an undirected 

tree /. The degrees of both u and v in G are at i ^ ^ 

is true ? 

(a) There must exist a vertex * adjacent to both u a 

lb) There must exist a vertext w whose remm^i a 

' icmovai dtsconr 

(c) There must exist a cycle in G containing u and 

(i d ) There must exist a cycle in G containing u and II 

| 4 . Consider the following graph 



U. abfehg 
IN', a f g h b e 


Among the following sequences 
I. a b e g hf 
ID. a bfh g e 
which are depth first traversals of the above graph ? 

(a) I, II and IV only 

(c) II. ra and IV only (d) 1 , m and IV only 







2. (b) 
7. (« 
12. (b) 


3. (<0 
8 . (</) 
13. (J) 


4. (d) 
9. id) 
14. (<A 


□ □□ 


